Jun 18 11:18:19 devstack cinder-volume[80732]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 18 11:18:19 devstack cinder-volume[80732]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 18 11:18:19 devstack cinder-volume[80732]: we strongly recommend against using it for new projects.
Jun 18 11:18:19 devstack cinder-volume[80732]: If you are already using Eventlet, we recommend migrating to a different
Jun 18 11:18:19 devstack cinder-volume[80732]: framework.  For more detail see
Jun 18 11:18:19 devstack cinder-volume[80732]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 18 11:18:19 devstack cinder-volume[80732]:   import eventlet  # noqa
Jun 18 11:18:22 devstack cinder-volume[80732]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=80732) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 18 11:18:22 devstack cinder-volume[80732]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=80732) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 18 11:18:22 devstack cinder-volume[80732]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=80732) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 18 11:18:22 devstack cinder-volume[80732]: INFO dbcounter [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Registered counter for database cinder
Jun 18 11:18:22 devstack cinder-volume[80732]: DEBUG oslo_db.sqlalchemy.engines [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80732) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 18 11:18:23 devstack cinder-volume[80732]: DEBUG dbcounter [-] [80732] Writer thread running {{(pid=80732) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 18 11:18:23 devstack cinder-volume[80732]: INFO cinder.rpc [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 18 11:18:23 devstack cinder-volume[80732]: INFO cinder.rpc [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 18 11:18:23 devstack cinder-volume[80732]: DEBUG oslo_db.sqlalchemy.engines [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80732) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 18 11:18:23 devstack cinder-volume[80732]: INFO cinder.volume.manager [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Determined volume DB was empty at startup.
Jun 18 11:18:23 devstack cinder-volume[80732]: DEBUG cinder.volume.manager [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=80732) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 18 11:18:23 devstack cinder-volume[80732]: INFO cinder.volume.manager [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 18 11:18:23 devstack cinder-volume[80732]: WARNING stevedore.named [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 18 11:18:23 devstack cinder-volume[80732]: WARNING castellan.key_manager [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 18 11:18:23 devstack cinder-volume[80732]: WARNING cinder.keymgr.conf_key_mgr [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 18 11:18:23 devstack cinder-volume[80732]: DEBUG cinder.volume.drivers.lvm [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=80732) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jun 18 11:18:23 devstack cinder-volume[80732]: DEBUG oslo_concurrency.processutils [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=80732) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:23 devstack cinder-volume[80732]: DEBUG oslo_concurrency.processutils [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] CMD "cinder-rtstool verify" returned: 0 in 0.432s {{(pid=80732) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:23 devstack cinder-volume[80732]: DEBUG oslo_db.sqlalchemy.engines [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80732) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 18 11:18:23 devstack cinder-volume[80732]: INFO cinder.rpc [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jun 18 11:18:23 devstack cinder-volume[80732]: INFO cinder.rpc [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jun 18 11:18:23 devstack cinder-volume[80732]: WARNING stevedore.named [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 18 11:18:23 devstack cinder-volume[80732]: WARNING castellan.key_manager [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 18 11:18:23 devstack cinder-volume[80732]: INFO cinder.volume.manager [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_db.sqlalchemy.engines [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80732) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 18 11:18:24 devstack cinder-volume[80732]: INFO oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Starting 1 workers
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Started child 80904 {{(pid=80732) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Full set of CONF: {{(pid=80732) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] ******************************************************************************** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Configuration options gathered from: {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] ================================================================================ {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] allow_availability_zone_fallback = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] allow_compression_on_image_upload = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] allowed_direct_url_schemes     = [] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80904]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] api_rate_limit                 = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] auth_strategy                  = keystone {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] az_cache_duration              = 3600 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_availability_zone      = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_host                   = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_name                   = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_stats_polling_interval = 60 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backup_api_class               = cinder.backup.api.API {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backup_name_template           = backup-%s {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backup_use_same_host           = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backup_use_temp_snapshot       = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] chap_password                  = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] chap_username                  =  {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cinder_internal_tenant_project_id = 7c685ccd94e145029e105b4db302641d {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cinder_internal_tenant_user_id = 3b33d9f126fa44429191ef29c5f21e0a {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cloned_volume_same_az          = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cluster                        = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] compression_format             = gzip {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] compute_api_class              = cinder.compute.nova.API {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] config_dir                     = [] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] config_source                  = [] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] control_exchange               = openstack {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] debug                          = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] default_availability_zone      = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] default_group_type             = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] default_volume_type            = lvmdriver-1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] disk_geometry                  = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] driver_client_cert             = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] driver_client_cert_key         = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] driver_data_namespace          = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] driver_ssl_cert_path           = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] driver_ssl_cert_verify         = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] driver_use_ssl                 = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] enable_force_upload            = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] enable_new_services            = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] enable_unsupported_driver      = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] enforce_multipath_for_image_xfer = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] filter_function                = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance_api_insecure            = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance_api_servers             = ['http://192.168.122.90/image'] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance_api_ssl_compression     = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance_ca_certificates_file    = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance_catalog_info            = image:glance:publicURL {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance_certfile                = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance_keyfile                 = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance_num_retries             = 3 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance_request_timeout         = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] goodness_function              = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] graceful_shutdown_timeout      = 5 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] group_api_class                = cinder.group.api.API {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] host                           = devstack {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] image_compress_on_upload       = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] image_conversion_address_space_limit = 1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] image_conversion_cpu_limit     = 60 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] image_conversion_disable       = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] image_upload_use_cinder_backend = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] image_upload_use_internal_tenant = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] image_volume_cache_enabled     = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] image_volume_cache_max_count   = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] image_volume_cache_max_size_gb = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] init_host_max_objects_retrieval = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] instance_format                = [instance: %(uuid)s]  {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] iscsi_target_flags             =  {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] iscsi_write_cache              = on {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] iser_helper                    = tgtadm {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] iser_ip_address                = 192.168.122.90 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] iser_port                      = 3260 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] log_color                      = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] log_config_append              = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] log_dir                        = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] log_file                       = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] log_options                    = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] log_rotate_interval            = 1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] log_rotate_interval_type       = days {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] log_rotation_type              = none {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] max_age                        = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] max_logfile_count              = 30 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] max_logfile_size_mb            = 200 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] max_over_subscription_ratio    = 20.0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] message_reap_interval          = 86400 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] message_ttl                    = 2592000 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] migration_create_volume_timeout_secs = 300 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] monkey_patch                   = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] monkey_patch_modules           = [] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] my_ip                          = 192.168.122.90 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] no_snapshot_gb_quota           = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] num_iser_scan_tries            = 3 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] num_shell_tries                = 3 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] num_volume_device_scan_tries   = 3 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] nvmeof_conn_info_version       = 1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] nvmet_ns_id                    = 10 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] nvmet_port_id                  = 1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] osapi_max_limit                = 1000 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] osapi_volume_ext_list          = [] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] osapi_volume_listen_port       = 8776 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] osapi_volume_use_ssl           = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80904]: INFO cinder.volume.manager [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] osapi_volume_workers           = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] per_volume_size_limit          = -1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] periodic_fuzzy_delay           = 60 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] periodic_interval              = 60 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] public_endpoint                = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] publish_errors                 = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack sudo[80908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jun 18 11:18:24 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:24 devstack sudo[80908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] quota_backup_gigabytes         = 1000 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] quota_backups                  = 10 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] quota_gigabytes                = 1000 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] quota_groups                   = 10 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] quota_snapshots                = 10 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] quota_volumes                  = 10 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] rate_limit_burst               = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] rate_limit_except_level        = CRITICAL {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] rate_limit_interval            = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] reinit_driver_count            = 3 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] replication_device             = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] report_discard_supported       = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] report_interval                = 120 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] reservation_clean_interval     = 86400 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] reservation_expire             = 86400 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] reserved_image_namespaces      = [] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] reserved_percentage            = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] rpc_response_timeout           = 120 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] run_external_periodic_tasks    = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] scst_target_driver             = iscsi {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] scst_target_iqn_name           = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] service_down_time              = 720 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] shell_completion               = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] snapshot_name_template         = snapshot-%s {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] snapshot_same_host             = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] split_loggers                  = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] state_path                     = /opt/stack/data/cinder {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] storage_availability_zone      = nova {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] storage_protocol               = iSCSI {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] syslog_log_facility            = LOG_USER {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] target_helper                  = lioadm {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] target_ip_address              = 192.168.122.90 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] target_port                    = 3260 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] target_protocol                = iscsi {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] target_secondary_ip_addresses  = [] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] trace_flags                    = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] transport_url                  = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] until_refresh                  = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] use_chap_auth                  = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] use_default_quota_class        = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] use_journal                    = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] use_json                       = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] use_multipath_for_image_xfer   = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] use_stderr                     = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] use_syslog                     = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] verify_glance_signatures       = enabled {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] volume_api_class               = cinder.volume.api.API {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] volume_backend_name            = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] volume_clear                   = zero {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] volume_clear_ionice            = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] volume_clear_size              = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] volume_copy_bps_limit          = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] volume_dd_blocksize            = 1M {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] volume_name_template           = volume-%s {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] volume_service_inithost_offload = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] volume_usage_audit_period      = month {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] zoning_mode                    = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_concurrency.disable_process_locking = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.auth_section = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.auth_type   = password {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.auth_version = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.cache       = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.certfile    = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.delay_auth_decision = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.http_connect_timeout = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.include_service_catalog = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.insecure    = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.interface   = public {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.keyfile     = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.memcache_password =  {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.memcache_username =  {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.region_name = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.service_token_roles_required = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.service_type = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.token_cache_time = 300 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.90/identity {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.backend                  = dogpile.cache.null {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.backend_argument         = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.backend_expiration_time  = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.config_prefix            = cache.oslo {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.debug_cache_backend      = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.enable_retry_client      = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.enable_socket_keepalive  = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.enabled                  = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.expiration_time          = 600 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.hashclient_retry_attempts = 2 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.memcache_dead_retry      = 300 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.memcache_pool_maxsize    = 10 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.memcache_sasl_enabled    = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.password                 = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.proxies                  = [] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.redis_db                 = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.redis_sentinel_service_name = mymaster {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.redis_server             = localhost:6379 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.retry_attempts           = 2 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.retry_delay              = 0.0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.socket_keepalive_count   = 1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.socket_keepalive_idle    = 1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.socket_keepalive_interval = 1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.socket_timeout           = 1.0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.tls_allowed_ciphers      = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.tls_cafile               = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.tls_certfile             = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.tls_enabled              = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.tls_keyfile              = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cache.username                 = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] coordination.backend_url       = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.asyncio_connection    = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.asyncio_slave_connection = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.backend               = sqlalchemy {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.connection            = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.connection_debug      = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.connection_parameters =  {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.connection_recycle_time = 3600 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.connection_trace      = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.db_inc_retry_interval = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.db_max_retries        = 20 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.db_max_retry_interval = 10 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.db_retry_interval     = 1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.max_overflow          = 50 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.max_pool_size         = 5 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.max_retries           = 10 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.mysql_wsrep_sync_wait = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.pool_timeout          = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.retry_interval        = 10 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.slave_connection      = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.sqlite_synchronous    = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.synchronous_reader    = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] database.use_db_reconnect      = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] profiler.connection_string     = messaging:// {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] profiler.enabled               = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] profiler.es_doc_type           = notification {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] profiler.es_scroll_size        = 10000 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] profiler.es_scroll_time        = 2m {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] profiler.filter_error_trace    = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] profiler.hmac_keys             = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] profiler.sentinel_service_name = mymaster {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] profiler.socket_timeout        = 0.1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] profiler.trace_requests        = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] profiler.trace_sqlalchemy      = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] profiler_jaeger.process_tags   = {} {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] profiler_jaeger.service_name_prefix = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] profiler_otlp.service_name_prefix = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_policy.enforce_new_defaults = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: WARNING oslo_config.cfg [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_policy.enforce_scope      = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_policy.policy_default_rule = default {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_policy.policy_file        = policy.yaml {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] privsep_osbrick.group          = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] privsep_osbrick.helper_command = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] privsep_osbrick.user           = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cinder_sys_admin.group         = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cinder_sys_admin.helper_command = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] cinder_sys_admin.user          = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] service_user.auth_section      = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] service_user.auth_type         = password {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] service_user.cafile            = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] service_user.certfile          = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] service_user.collect_timing    = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] service_user.insecure          = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] service_user.keyfile           = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] service_user.send_service_user_token = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] service_user.split_loggers     = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] service_user.timeout           = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance.auth_section            = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance.auth_type               = password {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance.certfile                = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance.collect_timing          = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance.insecure                = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance.keyfile                 = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance.region_name             = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance.split_loggers           = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] glance.timeout                 = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.backend_availability_zone = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.chap_password = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.chap_username =  {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.disk_geometry = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.driver_client_cert = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.driver_client_cert_key = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.driver_data_namespace = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.driver_use_ssl = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.enable_unsupported_driver = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.extra_capabilities = {} {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.filter_function = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.goodness_function = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.iscsi_target_flags =  {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.iscsi_write_cache = on {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.iser_helper   = tgtadm {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.iser_ip_address = 192.168.122.90 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.iser_port     = 3260 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.lvm_share_target = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.lvm_type      = auto {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.num_shell_tries = 3 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.nvmet_port_id = 1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.replication_device = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.report_discard_supported = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.reserved_percentage = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.scst_target_driver = iscsi {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.scst_target_iqn_name = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.storage_protocol = iSCSI {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.target_helper = tgtadm {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.target_ip_address = 192.168.122.90 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.target_port   = 3260 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.target_protocol = iscsi {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.trace_flags   = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.unique_fqdn_network = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.use_chap_auth = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.volume_backend_name = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.volume_clear  = zero {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.volume_clear_ionice = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.volume_clear_size = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_reports.file_event_handler = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_reports.log_dir           = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.backend_availability_zone = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.backend_host       = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.chap_password      = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.chap_username      = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.disk_geometry      = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.driver_client_cert = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.driver_data_namespace = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.extra_capabilities = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.filter_function    = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.goodness_function  = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.iser_helper        = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.iser_ip_address    = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.iser_port          = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.iser_target_prefix = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.lvm_share_target   = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.lvm_type           = auto {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.num_shell_tries    = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.replication_device = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.report_discard_supported = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.reserved_percentage = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.scst_target_driver = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.storage_protocol   = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.target_helper      = lioadm {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.target_ip_address  = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.target_port        = 3260 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.trace_flags        = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.use_chap_auth      = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.volume_clear       = zero {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.volume_clear_size  = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] lvmdriver-1.volumes_dir        = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.ssl      = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_notifications.driver = [] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_notifications.retry = -1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] oslo_messaging_notifications.transport_url = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] key_manager.fixed_key          = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican.barbican_api_version  = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican.barbican_endpoint     = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican.barbican_endpoint_type = public {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican.barbican_region_name  = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican.cafile                = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican.certfile              = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican.collect_timing        = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican.insecure              = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican.keyfile               = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican.number_of_retries     = 60 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican.retry_delay           = 1 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican.send_service_user_token = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican.split_loggers         = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican.timeout               = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican.verify_ssl            = True {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican.verify_ssl_path       = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican_service_user.auth_section = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican_service_user.auth_type = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican_service_user.cafile   = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican_service_user.certfile = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican_service_user.collect_timing = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican_service_user.insecure = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican_service_user.keyfile  = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican_service_user.split_loggers = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] barbican_service_user.timeout  = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] vault.approle_role_id          = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] vault.approle_secret_id        = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] vault.kv_mountpoint            = secret {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] vault.kv_path                  = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] vault.kv_version               = 2 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] vault.namespace                = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] vault.root_token_id            = **** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] vault.ssl_ca_crt_file          = None {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] vault.timeout                  = 60.0 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] vault.use_ssl                  = False {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:18:24 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] ******************************************************************************** {{(pid=80732) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 18 11:18:25 devstack sudo[80908]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:25 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.741s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:25 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:25 devstack sudo[80972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 18 11:18:25 devstack sudo[80972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:25 devstack sudo[80972]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:25 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.658s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:25 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:18:25 devstack cinder-volume[80904]: INFO cinder.brick.local_dev.lvm [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jun 18 11:18:25 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:25 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:25 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:25 devstack sudo[81217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 18 11:18:25 devstack sudo[81217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:26 devstack sudo[81217]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:26 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:26 devstack cinder-volume[80904]: DEBUG cinder.brick.local_dev.lvm [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=80904) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jun 18 11:18:26 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:26 devstack sudo[81400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 18 11:18:26 devstack sudo[81400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:27 devstack sudo[81400]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:27 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.418s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:27 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:27 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:27 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:27 devstack sudo[81663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 18 11:18:27 devstack sudo[81663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:28 devstack sudo[81663]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:28 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.713s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:28 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:28 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:28 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:28 devstack sudo[81690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jun 18 11:18:28 devstack sudo[81690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:29 devstack sudo[81690]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:29 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.666s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:29 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:29 devstack sudo[81694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 18 11:18:29 devstack sudo[81694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:29 devstack sudo[81694]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:29 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.710s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:29 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:30 devstack sudo[81706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 18 11:18:30 devstack sudo[81706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:30 devstack sudo[81706]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:30 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.891s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:30 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:30 devstack sudo[81710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 18 11:18:30 devstack sudo[81710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:31 devstack sudo[81710]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:31 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.781s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:31 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:31 devstack sudo[81715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 18 11:18:31 devstack sudo[81715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:32 devstack sudo[81715]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:32 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.857s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:32 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:32 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:32 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:32 devstack sudo[81722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 18 11:18:32 devstack sudo[81722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:33 devstack sudo[81722]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:33 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.728s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:33 devstack cinder-volume[80904]: INFO cinder.volume.drivers.lvm [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jun 18 11:18:33 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:33 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:33 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:33 devstack sudo[81738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 18 11:18:33 devstack sudo[81738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:34 devstack sudo[81738]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:34 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.802s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:34 devstack cinder-volume[80904]: DEBUG cinder.volume.drivers.lvm [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Updating volume stats {{(pid=80904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 18 11:18:34 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:34 devstack sudo[81851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 18 11:18:34 devstack sudo[81851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:34 devstack cinder-volume[80732]: DEBUG dbcounter [-] [80732] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=80732) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:18:34 devstack sudo[81851]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:34 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.718s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:34 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:34 devstack sudo[81993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 18 11:18:34 devstack sudo[81993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:35 devstack sudo[81993]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:35 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:35 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:35 devstack sudo[81996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 18 11:18:35 devstack sudo[81996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:36 devstack sudo[81996]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:36 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.635s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:36 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:36 devstack sudo[81999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 18 11:18:36 devstack sudo[81999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:36 devstack sudo[81999]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:36 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:36 devstack cinder-volume[80904]: INFO cinder.volume.driver [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Driver hasn't implemented _init_vendor_properties()
Jun 18 11:18:36 devstack cinder-volume[80904]: DEBUG cinder.volume.driver [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=80904) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 18 11:18:36 devstack cinder-volume[80904]: DEBUG oslo_db.sqlalchemy.engines [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80904) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 18 11:18:36 devstack cinder-volume[80904]: DEBUG dbcounter [-] [80904] Writer thread running {{(pid=80904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 18 11:18:36 devstack cinder-volume[80904]: DEBUG cinder.db.api [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Building query based on filter {{(pid=80904) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 18 11:18:36 devstack cinder-volume[80904]: DEBUG cinder.image.image_utils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=80904) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 18 11:18:36 devstack cinder-volume[80904]: INFO cinder.keymgr.migration [None req-986883b3-7017-43f9-8756-b22540186506 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 18 11:18:36 devstack cinder-volume[80904]: DEBUG cinder.volume.drivers.lvm [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Updating volume stats {{(pid=80904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 18 11:18:36 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:36 devstack sudo[82006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 18 11:18:36 devstack sudo[82006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:37 devstack sudo[82006]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:37 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:37 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:37 devstack sudo[82009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 18 11:18:37 devstack sudo[82009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:38 devstack sudo[82009]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:38 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:38 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:38 devstack sudo[82013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 18 11:18:38 devstack sudo[82013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:38 devstack sudo[82013]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:38 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.731s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:38 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:38 devstack sudo[82018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 18 11:18:38 devstack sudo[82018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:39 devstack sudo[82018]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:39 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:39 devstack cinder-volume[80904]: DEBUG cinder.manager [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Notifying Schedulers of capabilities ... {{(pid=80904) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:18:39 devstack cinder-volume[80904]: INFO cinder.volume.manager [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Driver initialization completed successfully.
Jun 18 11:18:39 devstack cinder-volume[80904]: INFO cinder.manager [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Initiating service 2 cleanup
Jun 18 11:18:39 devstack cinder-volume[80904]: INFO cinder.manager [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Service 2 cleanup completed.
Jun 18 11:18:39 devstack cinder-volume[80904]: DEBUG cinder.service [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Creating RPC server for service cinder-volume {{(pid=80904) start /opt/stack/cinder/cinder/service.py:231}}
Jun 18 11:18:39 devstack cinder-volume[80904]: DEBUG cinder.service [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=80904) start /opt/stack/cinder/cinder/service.py:237}}
Jun 18 11:18:39 devstack cinder-volume[80904]: INFO cinder.volume.manager [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jun 18 11:18:39 devstack cinder-volume[80904]: DEBUG cinder.volume.drivers.lvm [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Updating volume stats {{(pid=80904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 18 11:18:39 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:39 devstack sudo[82021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 18 11:18:39 devstack sudo[82021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:40 devstack sudo[82021]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:40 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:40 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:40 devstack sudo[82028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 18 11:18:40 devstack sudo[82028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:41 devstack sudo[82028]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:41 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:41 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:41 devstack sudo[82031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 18 11:18:41 devstack sudo[82031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:41 devstack sudo[82031]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:41 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.636s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:41 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:18:41 devstack sudo[82088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 18 11:18:41 devstack sudo[82088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:18:42 devstack sudo[82088]: pam_unix(sudo:session): session closed for user root
Jun 18 11:18:42 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:18:42 devstack cinder-volume[80904]: INFO cinder.volume.manager [None req-6a07937b-b9fe-4a08-8016-a9c4e08fe849 None None] Driver post RPC initialization completed successfully.
Jun 18 11:18:52 devstack cinder-volume[80904]: DEBUG dbcounter [-] [80904] Writing DB stats cinder:SELECT=3 {{(pid=80904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:18:52 devstack cinder-volume[80904]: DEBUG dbcounter [-] [80904] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=80904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:19:17 devstack cinder-volume[80904]: DEBUG oslo_service.periodic_task [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running periodic task VolumeManager._thread_info {{(pid=80904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:19:17 devstack cinder-volume[80904]: DEBUG cinder.volume.manager [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] thread count: 6 {{(pid=80904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:19:17 devstack cinder-volume[80904]: DEBUG cinder.volume.manager [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] thread info: [<_MainThread(MainThread, started 131106102833280)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131105991837376)>, <Thread(Thread-3 (stat_writer), started daemon 131105995638016)>, <Thread(Rabbit-heartbeat, started daemon 131105994188352)>, <Thread(Thread-5 (_runner), started daemon 131105990871424)>, <Thread(Thread-7 (_runner), started daemon 131105988892416)>] {{(pid=80904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:20:17 devstack cinder-volume[80904]: DEBUG oslo_service.periodic_task [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:20:17 devstack cinder-volume[80904]: DEBUG cinder.volume.drivers.lvm [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Updating volume stats {{(pid=80904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 18 11:20:17 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:20:17 devstack sudo[86930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 18 11:20:17 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:20:17 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root
Jun 18 11:20:17 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:20:17 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:20:17 devstack sudo[86933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 18 11:20:17 devstack sudo[86933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:20:18 devstack sudo[86933]: pam_unix(sudo:session): session closed for user root
Jun 18 11:20:18 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:20:18 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:20:18 devstack sudo[86937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 18 11:20:18 devstack sudo[86937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:20:19 devstack sudo[86937]: pam_unix(sudo:session): session closed for user root
Jun 18 11:20:19 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.633s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:20:19 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:20:19 devstack sudo[86940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 18 11:20:19 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:20:19 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root
Jun 18 11:20:19 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:20:19 devstack cinder-volume[80904]: DEBUG cinder.manager [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Notifying Schedulers of capabilities ... {{(pid=80904) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:20:19 devstack cinder-volume[80904]: DEBUG oslo_service.periodic_task [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running periodic task VolumeManager._thread_info {{(pid=80904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:20:19 devstack cinder-volume[80904]: DEBUG cinder.volume.manager [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] thread count: 6 {{(pid=80904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:20:19 devstack cinder-volume[80904]: DEBUG cinder.volume.manager [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] thread info: [<_MainThread(MainThread, started 131106102833280)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131105991837376)>, <Thread(Thread-3 (stat_writer), started daemon 131105995638016)>, <Thread(Rabbit-heartbeat, started daemon 131105994188352)>, <Thread(Thread-5 (_runner), started daemon 131105990871424)>, <Thread(Thread-7 (_runner), started daemon 131105988892416)>] {{(pid=80904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:20:52 devstack cinder-volume[80904]: DEBUG dbcounter [-] [80904] Writing DB stats cinder:SELECT=1 {{(pid=80904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:20:52 devstack cinder-volume[80904]: DEBUG dbcounter [-] [80904] Writing DB stats cinder:UPDATE=1 {{(pid=80904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:21:17 devstack cinder-volume[80904]: DEBUG oslo_service.periodic_task [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:21:17 devstack cinder-volume[80904]: DEBUG cinder.volume.drivers.lvm [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Updating volume stats {{(pid=80904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 18 11:21:17 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:21:17 devstack sudo[87357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 18 11:21:17 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:21:18 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root
Jun 18 11:21:18 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:21:18 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:21:18 devstack sudo[87365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 18 11:21:18 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:21:18 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root
Jun 18 11:21:18 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:21:18 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:21:18 devstack sudo[87376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 18 11:21:18 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:21:19 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root
Jun 18 11:21:19 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.627s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:21:19 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:21:19 devstack sudo[87380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 18 11:21:19 devstack sudo[87380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:21:19 devstack sudo[87380]: pam_unix(sudo:session): session closed for user root
Jun 18 11:21:19 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:21:19 devstack cinder-volume[80904]: DEBUG cinder.manager [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Notifying Schedulers of capabilities ... {{(pid=80904) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:21:19 devstack cinder-volume[80904]: DEBUG oslo_service.periodic_task [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running periodic task VolumeManager._thread_info {{(pid=80904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:21:19 devstack cinder-volume[80904]: DEBUG cinder.volume.manager [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] thread count: 6 {{(pid=80904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:21:19 devstack cinder-volume[80904]: DEBUG cinder.volume.manager [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] thread info: [<_MainThread(MainThread, started 131106102833280)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131105991837376)>, <Thread(Thread-3 (stat_writer), started daemon 131105995638016)>, <Thread(Rabbit-heartbeat, started daemon 131105994188352)>, <Thread(Thread-5 (_runner), started daemon 131105990871424)>, <Thread(Thread-7 (_runner), started daemon 131105988892416)>] {{(pid=80904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:22:17 devstack cinder-volume[80904]: DEBUG oslo_service.periodic_task [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:22:17 devstack cinder-volume[80904]: DEBUG cinder.volume.drivers.lvm [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Updating volume stats {{(pid=80904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 18 11:22:17 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:22:17 devstack sudo[89472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 18 11:22:17 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:22:18 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root
Jun 18 11:22:18 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:22:18 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:22:18 devstack sudo[89498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 18 11:22:18 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:22:18 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root
Jun 18 11:22:18 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:22:18 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:22:18 devstack sudo[89505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 18 11:22:18 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:22:19 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root
Jun 18 11:22:19 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.626s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:22:19 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:22:19 devstack sudo[89509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 18 11:22:19 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:22:19 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root
Jun 18 11:22:19 devstack cinder-volume[80904]: DEBUG oslo_concurrency.processutils [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=80904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:22:19 devstack cinder-volume[80904]: DEBUG cinder.manager [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Notifying Schedulers of capabilities ... {{(pid=80904) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:22:19 devstack cinder-volume[80904]: DEBUG oslo_service.periodic_task [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] Running periodic task VolumeManager._thread_info {{(pid=80904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:22:19 devstack cinder-volume[80904]: DEBUG cinder.volume.manager [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] thread count: 6 {{(pid=80904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:22:19 devstack cinder-volume[80904]: DEBUG cinder.volume.manager [None req-8c1a0796-4b34-4518-9cf4-6d957a0cec92 None None] thread info: [<_MainThread(MainThread, started 131106102833280)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131105991837376)>, <Thread(Thread-3 (stat_writer), started daemon 131105995638016)>, <Thread(Rabbit-heartbeat, started daemon 131105994188352)>, <Thread(Thread-5 (_runner), started daemon 131105990871424)>, <Thread(Thread-7 (_runner), started daemon 131105988892416)>] {{(pid=80904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:22:52 devstack cinder-volume[80904]: DEBUG dbcounter [-] [80904] Writing DB stats cinder:SELECT=1 {{(pid=80904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:22:52 devstack cinder-volume[80904]: DEBUG dbcounter [-] [80904] Writing DB stats cinder:UPDATE=1 {{(pid=80904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:23:12 devstack cinder-volume[80732]: INFO oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Caught SIGTERM, stopping children
Jun 18 11:23:12 devstack cinder-volume[80732]: DEBUG oslo_concurrency.lockutils [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Acquiring lock "singleton_lock" {{(pid=80732) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 18 11:23:12 devstack cinder-volume[80732]: DEBUG oslo_concurrency.lockutils [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Acquired lock "singleton_lock" {{(pid=80732) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 18 11:23:12 devstack cinder-volume[80732]: DEBUG oslo_concurrency.lockutils [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Releasing lock "singleton_lock" {{(pid=80732) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 18 11:23:12 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Stop services. {{(pid=80732) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 18 11:23:12 devstack cinder-volume[80732]: DEBUG oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Killing children. {{(pid=80732) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 18 11:23:12 devstack cinder-volume[80732]: INFO oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Waiting on 1 children to exit
Jun 18 11:23:14 devstack cinder-volume[80904]: DEBUG oslo_concurrency.lockutils [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Acquiring lock "singleton_lock" {{(pid=80904) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 18 11:23:14 devstack cinder-volume[80904]: DEBUG oslo_concurrency.lockutils [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Acquired lock "singleton_lock" {{(pid=80904) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 18 11:23:14 devstack cinder-volume[80904]: DEBUG oslo_concurrency.lockutils [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Releasing lock "singleton_lock" {{(pid=80904) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 18 11:23:14 devstack cinder-volume[80904]: WARNING amqp [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 18 11:23:14 devstack cinder-volume[80904]: WARNING amqp [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 18 11:23:14 devstack cinder-volume[80732]: INFO oslo_service.backend._eventlet.service [None req-9ea7acac-99fd-4db9-8488-f5b16f424383 None None] Child 80904 exited with status 0
Jun 18 11:23:15 devstack cinder-volume[90726]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 18 11:23:15 devstack cinder-volume[90726]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 18 11:23:15 devstack cinder-volume[90726]: we strongly recommend against using it for new projects.
Jun 18 11:23:15 devstack cinder-volume[90726]: If you are already using Eventlet, we recommend migrating to a different
Jun 18 11:23:15 devstack cinder-volume[90726]: framework.  For more detail see
Jun 18 11:23:15 devstack cinder-volume[90726]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 18 11:23:15 devstack cinder-volume[90726]:   import eventlet  # noqa
Jun 18 11:23:17 devstack cinder-volume[90726]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=90726) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 18 11:23:17 devstack cinder-volume[90726]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=90726) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 18 11:23:17 devstack cinder-volume[90726]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=90726) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 18 11:23:17 devstack cinder-volume[90726]: INFO dbcounter [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Registered counter for database cinder
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_db.sqlalchemy.engines [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=90726) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG dbcounter [-] [90726] Writer thread running {{(pid=90726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 18 11:23:18 devstack cinder-volume[90726]: INFO cinder.rpc [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 18 11:23:18 devstack cinder-volume[90726]: INFO cinder.rpc [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_db.sqlalchemy.engines [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=90726) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 18 11:23:18 devstack cinder-volume[90726]: INFO cinder.volume.manager [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Determined volume DB was empty at startup.
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG cinder.volume.manager [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=90726) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 18 11:23:18 devstack cinder-volume[90726]: INFO cinder.volume.manager [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 18 11:23:18 devstack cinder-volume[90726]: WARNING stevedore.named [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 18 11:23:18 devstack cinder-volume[90726]: WARNING castellan.key_manager [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 18 11:23:18 devstack cinder-volume[90726]: WARNING cinder.keymgr.conf_key_mgr [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 18 11:23:18 devstack cinder-volume[90726]: INFO cinder.volume.manager [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_db.sqlalchemy.engines [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=90726) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 18 11:23:18 devstack cinder-volume[90726]: INFO oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Starting 1 workers
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Started child 91000 {{(pid=90726) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Full set of CONF: {{(pid=90726) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] ******************************************************************************** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Configuration options gathered from: {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] ================================================================================ {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] allow_availability_zone_fallback = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] allow_compression_on_image_upload = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] allowed_direct_url_schemes     = [] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[91000]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] api_rate_limit                 = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] auth_strategy                  = keystone {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_availability_zone      = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_host                   = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_name                   = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_stats_polling_interval = 60 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backup_api_class               = cinder.backup.api.API {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backup_name_template           = backup-%s {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backup_use_same_host           = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backup_use_temp_snapshot       = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] chap_password                  = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] chap_username                  =  {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cinder_internal_tenant_project_id = 7c685ccd94e145029e105b4db302641d {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cinder_internal_tenant_user_id = 3b33d9f126fa44429191ef29c5f21e0a {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cluster                        = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] compression_format             = gzip {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] compute_api_class              = cinder.compute.nova.API {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] config_dir                     = [] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] config_source                  = [] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] control_exchange               = openstack {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] debug                          = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] default_availability_zone      = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] default_group_type             = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] default_volume_type            = QuobyteHD {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] disk_geometry                  = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] driver_client_cert             = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] driver_client_cert_key         = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] driver_data_namespace          = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] driver_ssl_cert_path           = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] driver_ssl_cert_verify         = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] driver_use_ssl                 = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] enable_new_services            = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] enable_unsupported_driver      = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] enabled_backends               = ['QuobyteHD'] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] enforce_multipath_for_image_xfer = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] filter_function                = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance_api_insecure            = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance_api_servers             = ['http://192.168.122.90/image'] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance_api_ssl_compression     = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance_ca_certificates_file    = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance_catalog_info            = image:glance:publicURL {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance_certfile                = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance_keyfile                 = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance_num_retries             = 3 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance_request_timeout         = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] goodness_function              = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] graceful_shutdown_timeout      = 5 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] group_api_class                = cinder.group.api.API {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] host                           = devstack {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] image_compress_on_upload       = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] image_conversion_address_space_limit = 1 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] image_conversion_cpu_limit     = 60 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] image_conversion_disable       = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] image_upload_use_cinder_backend = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] image_upload_use_internal_tenant = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] image_volume_cache_enabled     = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] image_volume_cache_max_count   = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] image_volume_cache_max_size_gb = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] init_host_max_objects_retrieval = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] iscsi_target_flags             =  {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] iscsi_write_cache              = on {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] iser_helper                    = tgtadm {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] iser_ip_address                = 192.168.122.90 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] iser_port                      = 3260 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] log_color                      = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] log_config_append              = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] log_dir                        = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] log_file                       = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] log_options                    = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] log_rotate_interval            = 1 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] log_rotate_interval_type       = days {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] log_rotation_type              = none {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] max_age                        = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] max_logfile_count              = 30 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] max_logfile_size_mb            = 200 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] max_over_subscription_ratio    = 20.0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] message_reap_interval          = 86400 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] message_ttl                    = 2592000 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] migration_create_volume_timeout_secs = 300 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] monkey_patch                   = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] monkey_patch_modules           = [] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] my_ip                          = 192.168.122.90 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] no_snapshot_gb_quota           = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] num_iser_scan_tries            = 3 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] num_shell_tries                = 3 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] num_volume_device_scan_tries   = 3 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] nvmeof_conn_info_version       = 1 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] nvmet_ns_id                    = 10 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] nvmet_port_id                  = 1 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] osapi_max_limit                = 1000 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:18 devstack cinder-volume[91000]: INFO cinder.volume.manager [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] osapi_volume_ext_list          = [] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] osapi_volume_listen_port       = 8776 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] osapi_volume_use_ssl           = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] osapi_volume_workers           = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] per_volume_size_limit          = -1 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] periodic_fuzzy_delay           = 60 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] periodic_interval              = 60 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[91000]: DEBUG cinder.volume.drivers.remotefs [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=91000) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] public_endpoint                = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] publish_errors                 = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] quota_backup_gigabytes         = 1000 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] quota_backups                  = 10 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] quota_gigabytes                = 1000 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] quota_groups                   = 10 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] quota_snapshots                = 10 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] quota_volumes                  = 10 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] rate_limit_burst               = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] rate_limit_except_level        = CRITICAL {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] rate_limit_interval            = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] reinit_driver_count            = 3 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] replication_device             = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] report_discard_supported       = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] report_interval                = 120 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] reservation_clean_interval     = 86400 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] reservation_expire             = 86400 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] reserved_image_namespaces      = [] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] reserved_percentage            = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] rpc_response_timeout           = 120 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] run_external_periodic_tasks    = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] scst_target_driver             = iscsi {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] scst_target_iqn_name           = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] service_down_time              = 720 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] shell_completion               = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] snapshot_name_template         = snapshot-%s {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] split_loggers                  = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] state_path                     = /opt/stack/data/cinder {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] storage_availability_zone      = nova {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] storage_protocol               = iSCSI {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] syslog_log_facility            = LOG_USER {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] target_helper                  = lioadm {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] target_ip_address              = 192.168.122.90 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] target_port                    = 3260 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] target_protocol                = iscsi {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] target_secondary_ip_addresses  = [] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] trace_flags                    = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] transport_url                  = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] until_refresh                  = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] use_chap_auth                  = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] use_default_quota_class        = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] use_journal                    = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] use_json                       = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] use_multipath_for_image_xfer   = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] use_stderr                     = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] use_syslog                     = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] verify_glance_signatures       = enabled {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] volume_api_class               = cinder.volume.api.API {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] volume_backend_name            = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] volume_clear                   = zero {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] volume_clear_ionice            = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] volume_clear_size              = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] volume_copy_bps_limit          = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] volume_dd_blocksize            = 1M {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] volume_name_template           = volume-%s {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] volume_service_inithost_offload = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] volume_usage_audit_period      = month {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] zoning_mode                    = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_concurrency.disable_process_locking = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.auth_section = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.auth_type   = password {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.auth_version = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.cache       = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.certfile    = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.include_service_catalog = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.insecure    = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.interface   = public {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.keyfile     = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.memcache_password =  {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.memcache_username =  {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.region_name = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.service_type = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.90/identity {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.backend                  = dogpile.cache.null {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.backend_argument         = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.backend_expiration_time  = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.config_prefix            = cache.oslo {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.debug_cache_backend      = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.enable_retry_client      = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.enable_socket_keepalive  = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.enabled                  = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.expiration_time          = 600 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.hashclient_retry_attempts = 2 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.memcache_dead_retry      = 300 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.memcache_sasl_enabled    = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.password                 = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.proxies                  = [] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.redis_db                 = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.redis_server             = localhost:6379 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.retry_attempts           = 2 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.retry_delay              = 0.0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.socket_keepalive_count   = 1 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.socket_keepalive_idle    = 1 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.socket_keepalive_interval = 1 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.socket_timeout           = 1.0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.tls_allowed_ciphers      = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.tls_cafile               = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.tls_certfile             = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.tls_enabled              = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.tls_keyfile              = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cache.username                 = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] coordination.backend_url       = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.asyncio_connection    = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.asyncio_slave_connection = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.backend               = sqlalchemy {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.connection            = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.connection_debug      = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.connection_parameters =  {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.connection_recycle_time = 3600 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.connection_trace      = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.db_inc_retry_interval = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.db_max_retries        = 20 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.db_max_retry_interval = 10 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.db_retry_interval     = 1 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.max_overflow          = 50 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.max_pool_size         = 5 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.max_retries           = 10 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.mysql_wsrep_sync_wait = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.pool_timeout          = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.retry_interval        = 10 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.slave_connection      = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.sqlite_synchronous    = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.synchronous_reader    = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] database.use_db_reconnect      = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] profiler.connection_string     = messaging:// {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] profiler.enabled               = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] profiler.es_doc_type           = notification {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] profiler.es_scroll_size        = 10000 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] profiler.es_scroll_time        = 2m {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] profiler.filter_error_trace    = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] profiler.hmac_keys             = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] profiler.sentinel_service_name = mymaster {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] profiler.socket_timeout        = 0.1 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] profiler.trace_requests        = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] profiler.trace_sqlalchemy      = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] profiler_jaeger.process_tags   = {} {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] profiler_jaeger.service_name_prefix = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] profiler_otlp.service_name_prefix = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_policy.enforce_new_defaults = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: WARNING oslo_config.cfg [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_policy.enforce_scope      = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_policy.policy_default_rule = default {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] privsep_osbrick.group          = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] privsep_osbrick.helper_command = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] privsep_osbrick.user           = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cinder_sys_admin.group         = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cinder_sys_admin.helper_command = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] cinder_sys_admin.user          = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] service_user.auth_section      = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] service_user.auth_type         = password {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] service_user.cafile            = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] service_user.certfile          = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] service_user.collect_timing    = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] service_user.insecure          = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] service_user.keyfile           = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] service_user.send_service_user_token = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] service_user.split_loggers     = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] service_user.timeout           = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance.auth_section            = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance.auth_type               = password {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance.certfile                = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance.collect_timing          = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance.insecure                = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance.keyfile                 = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance.region_name             = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance.split_loggers           = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] glance.timeout                 = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.backend_availability_zone = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.chap_password = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.chap_username =  {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.disk_geometry = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.driver_client_cert = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.driver_client_cert_key = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.driver_data_namespace = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.driver_use_ssl = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.extra_capabilities = {} {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.filter_function = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.goodness_function = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.iscsi_target_flags =  {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.iscsi_write_cache = on {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.iser_helper   = tgtadm {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.iser_ip_address = 192.168.122.90 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.iser_port     = 3260 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.nas_host      =  {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.nas_login     = admin {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.nas_mount_options = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.nas_password  = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.nas_private_key =  {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.nas_share_path =  {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.num_shell_tries = 3 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.quobyte_volume_url = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.replication_device = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.report_discard_supported = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.reserved_percentage = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.target_helper = tgtadm {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.target_ip_address = 192.168.122.90 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.target_port   = 3260 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.target_protocol = iscsi {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.trace_flags   = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.unique_fqdn_network = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.use_chap_auth = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.volume_backend_name = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.volume_clear  = zero {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.volume_clear_ionice = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.volume_clear_size = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_reports.file_event_handler = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_reports.log_dir           = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.backend_availability_zone = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.backend_host         = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.chap_password        = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.chap_username        = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.chiscsi_conf         = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.disk_geometry        = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.driver_client_cert   = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.driver_data_namespace = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.driver_use_ssl       = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.extra_capabilities   = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.filter_function      = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.goodness_function    = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.iser_helper          = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.iser_ip_address      = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.iser_port            = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.iser_target_prefix   = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.nas_host             = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.nas_login            = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.nas_mount_options    = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.nas_password         = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.nas_private_key      = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.nas_share_path       = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.nas_ssh_port         = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.num_shell_tries      = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.nvmet_port_id        = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.replication_device   = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.report_discard_supported = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.reserved_percentage  = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.scst_target_driver   = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.storage_protocol     = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.target_helper        = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.target_ip_address    = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.target_port          = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.target_prefix        = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.target_protocol      = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.trace_flags          = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.use_chap_auth        = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.volume_clear         = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.volume_clear_size    = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] QuobyteHD.volumes_dir          = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_notifications.driver = [] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_notifications.retry = -1 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] key_manager.fixed_key          = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[91000]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=91000) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 18 11:23:19 devstack cinder-volume[91000]: WARNING cinder.volume.drivers.quobyte [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican.barbican_api_version  = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican.barbican_endpoint     = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican.barbican_endpoint_type = public {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican.barbican_region_name  = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[91000]: WARNING cinder.volume.drivers.quobyte [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican.cafile                = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican.certfile              = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican.collect_timing        = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[91000]: DEBUG oslo_concurrency.processutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Running cmd (subprocess): mount.quobyte {{(pid=91000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican.insecure              = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican.keyfile               = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican.number_of_retries     = 60 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican.retry_delay           = 1 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican.send_service_user_token = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican.split_loggers         = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican.timeout               = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican.verify_ssl            = True {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican.verify_ssl_path       = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican_service_user.auth_section = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican_service_user.auth_type = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican_service_user.cafile   = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican_service_user.certfile = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican_service_user.collect_timing = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican_service_user.insecure = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican_service_user.keyfile  = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican_service_user.split_loggers = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] barbican_service_user.timeout  = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] vault.approle_role_id          = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] vault.approle_secret_id        = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] vault.kv_mountpoint            = secret {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] vault.kv_path                  = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] vault.kv_version               = 2 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] vault.namespace                = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] vault.root_token_id            = **** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] vault.ssl_ca_crt_file          = None {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] vault.timeout                  = 60.0 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] vault.use_ssl                  = False {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:19 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] ******************************************************************************** {{(pid=90726) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 18 11:23:19 devstack quobyte-client[91013]: Reading configuration file: /etc/quobyte/client.cfg
Jun 18 11:23:19 devstack quobyte-client[91013]: Invalid parameters found, error: missing mount point.
Jun 18 11:23:19 devstack quobyte-client[91013]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 18 11:23:19 devstack quobyte-client[91013]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 18 11:23:19 devstack cinder-volume[91000]: DEBUG oslo_concurrency.processutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] CMD "mount.quobyte" returned: 1 in 0.102s {{(pid=91000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:23:19 devstack cinder-volume[91000]: DEBUG oslo_concurrency.lockutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:23:19 devstack cinder-volume[91000]: DEBUG oslo_concurrency.lockutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:23:19 devstack cinder-volume[91000]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:23:19 devstack cinder-volume[91000]: INFO cinder.volume.drivers.quobyte [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e ...
Jun 18 11:23:19 devstack cinder-volume[91000]: DEBUG oslo_concurrency.processutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 -c /etc/quobyte/client-cinder.cfg {{(pid=91000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:23:19 devstack sudo[91014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 -c /etc/quobyte/client-cinder.cfg
Jun 18 11:23:19 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:23:20 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root
Jun 18 11:23:20 devstack cinder-volume[91000]: DEBUG oslo_concurrency.processutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.771s {{(pid=91000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:23:20 devstack cinder-volume[91000]: INFO cinder.volume.drivers.quobyte [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e succeeded
Jun 18 11:23:20 devstack cinder-volume[91000]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:23:20 devstack cinder-volume[91000]: DEBUG oslo_concurrency.lockutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.794s {{(pid=91000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:23:20 devstack cinder-volume[91000]: DEBUG oslo_concurrency.processutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:23:20 devstack sudo[91099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:23:20 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:23:20 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root
Jun 18 11:23:20 devstack cinder-volume[91000]: DEBUG oslo_concurrency.processutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.671s {{(pid=91000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:23:20 devstack cinder-volume[91000]: INFO cinder.volume.driver [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Driver hasn't implemented _init_vendor_properties()
Jun 18 11:23:20 devstack cinder-volume[91000]: DEBUG cinder.volume.driver [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757827758789, 'free_capacity_gb': 1775.757827758789, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91000) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 18 11:23:20 devstack cinder-volume[91000]: DEBUG oslo_db.sqlalchemy.engines [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91000) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 18 11:23:20 devstack cinder-volume[91000]: DEBUG dbcounter [-] [91000] Writer thread running {{(pid=91000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 18 11:23:20 devstack cinder-volume[91000]: DEBUG cinder.db.api [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Building query based on filter {{(pid=91000) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 18 11:23:20 devstack cinder-volume[91000]: DEBUG cinder.image.image_utils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=91000) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 18 11:23:20 devstack cinder-volume[91000]: INFO cinder.keymgr.migration [None req-7751c442-e104-4e5d-940e-8f9867aea3ef None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 18 11:23:20 devstack cinder-volume[91000]: DEBUG oslo_concurrency.lockutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:23:20 devstack cinder-volume[91000]: DEBUG oslo_concurrency.lockutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:23:20 devstack cinder-volume[91000]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:23:20 devstack cinder-volume[91000]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:23:20 devstack cinder-volume[91000]: DEBUG oslo_concurrency.lockutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:23:20 devstack cinder-volume[91000]: DEBUG oslo_concurrency.processutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:23:20 devstack sudo[91112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:23:20 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:23:21 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root
Jun 18 11:23:21 devstack cinder-volume[91000]: DEBUG oslo_concurrency.processutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.664s {{(pid=91000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:23:21 devstack cinder-volume[91000]: DEBUG cinder.manager [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Notifying Schedulers of capabilities ... {{(pid=91000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:23:21 devstack cinder-volume[91000]: INFO cinder.volume.manager [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Driver initialization completed successfully.
Jun 18 11:23:21 devstack cinder-volume[91000]: INFO cinder.manager [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Initiating service 3 cleanup
Jun 18 11:23:21 devstack cinder-volume[91000]: INFO cinder.manager [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Service 3 cleanup completed.
Jun 18 11:23:21 devstack cinder-volume[91000]: DEBUG cinder.service [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Creating RPC server for service cinder-volume {{(pid=91000) start /opt/stack/cinder/cinder/service.py:231}}
Jun 18 11:23:21 devstack cinder-volume[91000]: DEBUG cinder.service [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=91000) start /opt/stack/cinder/cinder/service.py:237}}
Jun 18 11:23:21 devstack cinder-volume[91000]: INFO cinder.volume.manager [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 18 11:23:21 devstack cinder-volume[91000]: DEBUG oslo_concurrency.lockutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:23:21 devstack cinder-volume[91000]: DEBUG oslo_concurrency.lockutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:23:21 devstack cinder-volume[91000]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:23:21 devstack cinder-volume[91000]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:23:21 devstack cinder-volume[91000]: DEBUG oslo_concurrency.lockutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:23:21 devstack cinder-volume[91000]: DEBUG oslo_concurrency.processutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:23:21 devstack sudo[91133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:23:21 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:23:22 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root
Jun 18 11:23:22 devstack cinder-volume[91000]: DEBUG oslo_concurrency.processutils [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.866s {{(pid=91000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:23:22 devstack cinder-volume[91000]: INFO cinder.volume.manager [None req-2ebf37fe-707d-4edb-9d4b-f4c59d6b115d None None] Driver post RPC initialization completed successfully.
Jun 18 11:23:26 devstack cinder-volume[91000]: DEBUG oslo_concurrency.lockutils [None req-07641da8-ceb6-4f8c-a84e-ef16732f1f46 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:23:26 devstack cinder-volume[91000]: DEBUG oslo_concurrency.lockutils [None req-07641da8-ceb6-4f8c-a84e-ef16732f1f46 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:23:26 devstack cinder-volume[91000]: DEBUG cinder.volume.drivers.quobyte [None req-07641da8-ceb6-4f8c-a84e-ef16732f1f46 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:23:26 devstack cinder-volume[91000]: DEBUG cinder.volume.drivers.quobyte [None req-07641da8-ceb6-4f8c-a84e-ef16732f1f46 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:23:26 devstack cinder-volume[91000]: DEBUG oslo_concurrency.lockutils [None req-07641da8-ceb6-4f8c-a84e-ef16732f1f46 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:23:26 devstack cinder-volume[91000]: DEBUG oslo_concurrency.processutils [None req-07641da8-ceb6-4f8c-a84e-ef16732f1f46 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:23:26 devstack sudo[91323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:23:26 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:23:27 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root
Jun 18 11:23:27 devstack cinder-volume[91000]: DEBUG oslo_concurrency.processutils [None req-07641da8-ceb6-4f8c-a84e-ef16732f1f46 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.593s {{(pid=91000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:23:27 devstack cinder-volume[91000]: DEBUG cinder.manager [None req-07641da8-ceb6-4f8c-a84e-ef16732f1f46 None None] Notifying Schedulers of capabilities ... {{(pid=91000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:23:28 devstack cinder-volume[90726]: INFO oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Caught SIGTERM, stopping children
Jun 18 11:23:28 devstack cinder-volume[90726]: DEBUG oslo_concurrency.lockutils [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Acquiring lock "singleton_lock" {{(pid=90726) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 18 11:23:28 devstack cinder-volume[90726]: DEBUG oslo_concurrency.lockutils [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Acquired lock "singleton_lock" {{(pid=90726) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 18 11:23:28 devstack cinder-volume[90726]: DEBUG oslo_concurrency.lockutils [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Releasing lock "singleton_lock" {{(pid=90726) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 18 11:23:28 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Stop services. {{(pid=90726) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 18 11:23:28 devstack cinder-volume[90726]: DEBUG oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Killing children. {{(pid=90726) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 18 11:23:28 devstack cinder-volume[90726]: INFO oslo_service.backend._eventlet.service [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Waiting on 1 children to exit
Jun 18 11:23:32 devstack cinder-volume[91000]: DEBUG dbcounter [-] [91000] Writing DB stats cinder:SELECT=3 {{(pid=91000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:23:32 devstack cinder-volume[91000]: DEBUG dbcounter [-] [91000] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=91000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:23:33 devstack cinder-volume[91000]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jun 18 11:23:34 devstack cinder-volume[91417]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 18 11:23:34 devstack cinder-volume[91417]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 18 11:23:34 devstack cinder-volume[91417]: we strongly recommend against using it for new projects.
Jun 18 11:23:34 devstack cinder-volume[91417]: If you are already using Eventlet, we recommend migrating to a different
Jun 18 11:23:34 devstack cinder-volume[91417]: framework.  For more detail see
Jun 18 11:23:34 devstack cinder-volume[91417]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 18 11:23:34 devstack cinder-volume[91417]:   import eventlet  # noqa
Jun 18 11:23:34 devstack cinder-volume[91000]: DEBUG oslo_concurrency.lockutils [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Acquiring lock "singleton_lock" {{(pid=91000) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 18 11:23:34 devstack cinder-volume[91000]: DEBUG oslo_concurrency.lockutils [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Acquired lock "singleton_lock" {{(pid=91000) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 18 11:23:34 devstack cinder-volume[91000]: DEBUG oslo_concurrency.lockutils [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Releasing lock "singleton_lock" {{(pid=91000) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 18 11:23:34 devstack cinder-volume[91000]: WARNING amqp [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 18 11:23:34 devstack cinder-volume[91000]: WARNING amqp [None req-2f181aed-7786-4820-b3b1-f30b16c822f0 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 18 11:23:36 devstack cinder-volume[91417]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 18 11:23:36 devstack cinder-volume[91417]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 18 11:23:36 devstack cinder-volume[91417]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 18 11:23:37 devstack cinder-volume[91417]: INFO dbcounter [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] Registered counter for database cinder
Jun 18 11:23:37 devstack cinder-volume[91417]: DEBUG oslo_db.sqlalchemy.engines [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91417) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 18 11:23:37 devstack cinder-volume[91417]: DEBUG dbcounter [-] [91417] Writer thread running {{(pid=91417) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 18 11:23:37 devstack cinder-volume[91417]: INFO cinder.rpc [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 18 11:23:37 devstack cinder-volume[91417]: INFO cinder.rpc [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 18 11:23:37 devstack cinder-volume[91417]: DEBUG oslo_db.sqlalchemy.engines [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91417) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 18 11:23:37 devstack cinder-volume[91417]: INFO cinder.volume.manager [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] Determined volume DB was empty at startup.
Jun 18 11:23:37 devstack cinder-volume[91417]: DEBUG cinder.volume.manager [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91417) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 18 11:23:37 devstack cinder-volume[91417]: WARNING stevedore.named [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 18 11:23:37 devstack cinder-volume[91417]: WARNING castellan.key_manager [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 18 11:23:37 devstack cinder-volume[91417]: WARNING cinder.keymgr.conf_key_mgr [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 18 11:23:37 devstack cinder-volume[91417]: INFO cinder.volume.manager [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 18 11:23:37 devstack cinder-volume[91417]: DEBUG oslo_db.sqlalchemy.engines [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91417) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 18 11:23:38 devstack cinder-volume[91417]: INFO oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] Starting 1 workers
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] Started child 91663 {{(pid=91417) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] Full set of CONF: {{(pid=91417) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] ******************************************************************************** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] Configuration options gathered from: {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] ================================================================================ {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] allow_availability_zone_fallback = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] allow_compression_on_image_upload = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] allowed_direct_url_schemes     = [] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91663]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] api_rate_limit                 = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] auth_strategy                  = keystone {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_availability_zone      = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_host                   = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_name                   = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_stats_polling_interval = 60 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backup_api_class               = cinder.backup.api.API {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backup_name_template           = backup-%s {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backup_use_same_host           = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backup_use_temp_snapshot       = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] chap_password                  = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] chap_username                  =  {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cinder_internal_tenant_project_id = 7c685ccd94e145029e105b4db302641d {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cinder_internal_tenant_user_id = 3b33d9f126fa44429191ef29c5f21e0a {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cluster                        = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] compression_format             = gzip {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] compute_api_class              = cinder.compute.nova.API {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] config_dir                     = [] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] config_source                  = [] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] control_exchange               = openstack {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] debug                          = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] default_availability_zone      = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] default_group_type             = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] default_volume_type            = QuobyteHD {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] disk_geometry                  = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] driver_client_cert             = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] driver_client_cert_key         = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] driver_data_namespace          = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] driver_ssl_cert_path           = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] driver_ssl_cert_verify         = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] driver_use_ssl                 = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] enable_new_services            = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] enable_unsupported_driver      = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] enabled_backends               = ['QuobyteHD'] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] enforce_multipath_for_image_xfer = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] filter_function                = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance_api_insecure            = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance_api_servers             = ['http://192.168.122.90/image'] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance_api_ssl_compression     = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance_ca_certificates_file    = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance_catalog_info            = image:glance:publicURL {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance_certfile                = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance_keyfile                 = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance_num_retries             = 3 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance_request_timeout         = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] goodness_function              = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] graceful_shutdown_timeout      = 5 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] group_api_class                = cinder.group.api.API {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] host                           = devstack {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] image_compress_on_upload       = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] image_conversion_address_space_limit = 1 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] image_conversion_cpu_limit     = 60 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] image_conversion_disable       = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] image_upload_use_cinder_backend = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] image_upload_use_internal_tenant = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] image_volume_cache_enabled     = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] image_volume_cache_max_count   = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] image_volume_cache_max_size_gb = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] init_host_max_objects_retrieval = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] iscsi_target_flags             =  {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] iscsi_write_cache              = on {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] iser_helper                    = tgtadm {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] iser_ip_address                = 192.168.122.90 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] iser_port                      = 3260 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] log_color                      = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] log_config_append              = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] log_dir                        = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] log_file                       = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] log_options                    = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] log_rotate_interval            = 1 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] log_rotate_interval_type       = days {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] log_rotation_type              = none {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] max_age                        = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] max_logfile_count              = 30 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] max_logfile_size_mb            = 200 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] max_over_subscription_ratio    = 20.0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] message_reap_interval          = 86400 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] message_ttl                    = 2592000 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] migration_create_volume_timeout_secs = 300 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] monkey_patch                   = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] monkey_patch_modules           = [] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] my_ip                          = 192.168.122.90 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] no_snapshot_gb_quota           = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] num_iser_scan_tries            = 3 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] num_shell_tries                = 3 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] num_volume_device_scan_tries   = 3 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] nvmeof_conn_info_version       = 1 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] nvmet_ns_id                    = 10 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] nvmet_port_id                  = 1 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] osapi_max_limit                = 1000 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] osapi_volume_ext_list          = [] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] osapi_volume_listen_port       = 8776 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] osapi_volume_use_ssl           = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] osapi_volume_workers           = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] per_volume_size_limit          = -1 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] periodic_fuzzy_delay           = 60 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] periodic_interval              = 60 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] public_endpoint                = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] publish_errors                 = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] quota_backup_gigabytes         = 1000 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] quota_backups                  = 10 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] quota_gigabytes                = 1000 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] quota_groups                   = 10 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] quota_snapshots                = 10 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] quota_volumes                  = 10 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] rate_limit_burst               = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] rate_limit_except_level        = CRITICAL {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] rate_limit_interval            = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] reinit_driver_count            = 3 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] replication_device             = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] report_discard_supported       = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] report_interval                = 120 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=91663) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] reservation_clean_interval     = 86400 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] reservation_expire             = 86400 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] reserved_image_namespaces      = [] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] reserved_percentage            = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] rpc_response_timeout           = 120 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] run_external_periodic_tasks    = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] scst_target_driver             = iscsi {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] scst_target_iqn_name           = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] service_down_time              = 720 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] shell_completion               = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] snapshot_name_template         = snapshot-%s {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] split_loggers                  = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] state_path                     = /opt/stack/data/cinder {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] storage_availability_zone      = nova {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] storage_protocol               = iSCSI {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] syslog_log_facility            = LOG_USER {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] target_helper                  = lioadm {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] target_ip_address              = 192.168.122.90 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] target_port                    = 3260 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] target_protocol                = iscsi {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] target_secondary_ip_addresses  = [] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] trace_flags                    = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] transport_url                  = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] until_refresh                  = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] use_chap_auth                  = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] use_default_quota_class        = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] use_journal                    = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] use_json                       = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] use_multipath_for_image_xfer   = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] use_stderr                     = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] use_syslog                     = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] verify_glance_signatures       = enabled {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] volume_api_class               = cinder.volume.api.API {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] volume_backend_name            = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] volume_clear                   = zero {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] volume_clear_ionice            = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] volume_clear_size              = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] volume_copy_bps_limit          = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] volume_dd_blocksize            = 1M {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] volume_name_template           = volume-%s {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] volume_service_inithost_offload = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] volume_usage_audit_period      = month {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] zoning_mode                    = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_concurrency.disable_process_locking = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.auth_section = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.auth_type   = password {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.auth_version = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.cache       = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.certfile    = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.include_service_catalog = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.insecure    = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.interface   = public {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.keyfile     = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.memcache_password =  {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.memcache_username =  {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.region_name = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.service_type = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.90/identity {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.backend                  = dogpile.cache.null {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.backend_argument         = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.backend_expiration_time  = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.config_prefix            = cache.oslo {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.debug_cache_backend      = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.enable_retry_client      = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.enable_socket_keepalive  = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.enabled                  = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.expiration_time          = 600 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.hashclient_retry_attempts = 2 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.memcache_dead_retry      = 300 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.memcache_sasl_enabled    = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.password                 = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.proxies                  = [] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.redis_db                 = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.redis_server             = localhost:6379 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.retry_attempts           = 2 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.retry_delay              = 0.0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.socket_keepalive_count   = 1 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.socket_keepalive_idle    = 1 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.socket_keepalive_interval = 1 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.socket_timeout           = 1.0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.tls_allowed_ciphers      = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.tls_cafile               = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.tls_certfile             = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.tls_enabled              = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.tls_keyfile              = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cache.username                 = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] coordination.backend_url       = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.asyncio_connection    = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.asyncio_slave_connection = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.backend               = sqlalchemy {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.connection            = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.connection_debug      = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.connection_parameters =  {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.connection_recycle_time = 3600 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.connection_trace      = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.db_inc_retry_interval = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.db_max_retries        = 20 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.db_max_retry_interval = 10 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.db_retry_interval     = 1 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.max_overflow          = 50 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.max_pool_size         = 5 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.max_retries           = 10 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.mysql_wsrep_sync_wait = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.pool_timeout          = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.retry_interval        = 10 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.slave_connection      = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.sqlite_synchronous    = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.synchronous_reader    = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] database.use_db_reconnect      = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] profiler.connection_string     = messaging:// {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] profiler.enabled               = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] profiler.es_doc_type           = notification {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] profiler.es_scroll_size        = 10000 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] profiler.es_scroll_time        = 2m {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] profiler.filter_error_trace    = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] profiler.hmac_keys             = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] profiler.sentinel_service_name = mymaster {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] profiler.socket_timeout        = 0.1 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] profiler.trace_requests        = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] profiler.trace_sqlalchemy      = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] profiler_jaeger.process_tags   = {} {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] profiler_jaeger.service_name_prefix = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] profiler_otlp.service_name_prefix = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_policy.enforce_new_defaults = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: WARNING oslo_config.cfg [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_policy.enforce_scope      = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_policy.policy_default_rule = default {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] privsep_osbrick.group          = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] privsep_osbrick.helper_command = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] privsep_osbrick.user           = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cinder_sys_admin.group         = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cinder_sys_admin.helper_command = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=91663) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 18 11:23:38 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.quobyte [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] cinder_sys_admin.user          = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] service_user.auth_section      = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] service_user.auth_type         = password {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] service_user.cafile            = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] service_user.certfile          = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] service_user.collect_timing    = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.quobyte [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] service_user.insecure          = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] service_user.keyfile           = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] service_user.send_service_user_token = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] service_user.split_loggers     = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Running cmd (subprocess): mount.quobyte {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] service_user.timeout           = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance.auth_section            = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance.auth_type               = password {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance.certfile                = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance.collect_timing          = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance.insecure                = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance.keyfile                 = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance.region_name             = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance.split_loggers           = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] glance.timeout                 = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.backend_availability_zone = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.chap_password = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.chap_username =  {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.disk_geometry = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.driver_client_cert = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.driver_client_cert_key = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.driver_data_namespace = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.driver_use_ssl = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.extra_capabilities = {} {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.filter_function = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.goodness_function = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.iscsi_target_flags =  {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.iscsi_write_cache = on {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.iser_helper   = tgtadm {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.iser_ip_address = 192.168.122.90 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.iser_port     = 3260 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.nas_host      =  {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.nas_login     = admin {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.nas_mount_options = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.nas_password  = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.nas_private_key =  {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.nas_share_path =  {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.num_shell_tries = 3 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.quobyte_volume_url = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.replication_device = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.report_discard_supported = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.reserved_percentage = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.target_helper = tgtadm {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.target_ip_address = 192.168.122.90 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.target_port   = 3260 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.target_protocol = iscsi {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.trace_flags   = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.unique_fqdn_network = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.use_chap_auth = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.volume_backend_name = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.volume_clear  = zero {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.volume_clear_ionice = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.volume_clear_size = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_reports.file_event_handler = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_reports.log_dir           = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.backend_availability_zone = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.backend_host         = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.chap_password        = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.chap_username        = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.chiscsi_conf         = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.disk_geometry        = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.driver_client_cert   = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.driver_data_namespace = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.driver_use_ssl       = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.extra_capabilities   = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.filter_function      = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.goodness_function    = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.iser_helper          = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.iser_ip_address      = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.iser_port            = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.iser_target_prefix   = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.nas_host             = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.nas_login            = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.nas_mount_options    = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.nas_password         = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.nas_private_key      = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.nas_share_path       = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.nas_ssh_port         = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.num_shell_tries      = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.nvmet_port_id        = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.replication_device   = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.report_discard_supported = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.reserved_percentage  = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.scst_target_driver   = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.storage_protocol     = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.target_helper        = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.target_ip_address    = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.target_port          = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.target_prefix        = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.target_protocol      = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.trace_flags          = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.use_chap_auth        = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.volume_clear         = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.volume_clear_size    = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] QuobyteHD.volumes_dir          = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_notifications.driver = [] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_notifications.retry = -1 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] key_manager.fixed_key          = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican.barbican_api_version  = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack quobyte-client[91664]: Reading configuration file: /etc/quobyte/client.cfg
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican.barbican_endpoint     = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican.barbican_endpoint_type = public {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican.barbican_region_name  = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican.cafile                = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack quobyte-client[91664]: Invalid parameters found, error: missing mount point.
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican.certfile              = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican.collect_timing        = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican.insecure              = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican.keyfile               = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack quobyte-client[91664]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican.number_of_retries     = 60 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican.retry_delay           = 1 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican.send_service_user_token = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican.split_loggers         = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican.timeout               = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack quobyte-client[91664]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican.verify_ssl            = True {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican.verify_ssl_path       = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican_service_user.auth_section = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican_service_user.auth_type = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican_service_user.cafile   = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican_service_user.certfile = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican_service_user.collect_timing = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican_service_user.insecure = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican_service_user.keyfile  = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican_service_user.split_loggers = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] barbican_service_user.timeout  = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] vault.approle_role_id          = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] vault.approle_secret_id        = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] vault.kv_mountpoint            = secret {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] vault.kv_path                  = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] vault.kv_version               = 2 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] vault.namespace                = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] vault.root_token_id            = **** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] vault.ssl_ca_crt_file          = None {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] vault.timeout                  = 60.0 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] vault.use_ssl                  = False {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 18 11:23:38 devstack cinder-volume[91417]: DEBUG oslo_service.backend._eventlet.service [None req-8f01a843-4251-4308-8eda-f453801635a0 None None] ******************************************************************************** {{(pid=91417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] CMD "mount.quobyte" returned: 1 in 0.087s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:23:38 devstack sudo[91665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:23:38 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:23:38 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.591s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:23:38 devstack cinder-volume[91663]: INFO cinder.volume.driver [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Driver hasn't implemented _init_vendor_properties()
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG cinder.volume.driver [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757827758789, 'free_capacity_gb': 1775.757827758789, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91663) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG oslo_db.sqlalchemy.engines [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91663) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writer thread running {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG cinder.db.api [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Building query based on filter {{(pid=91663) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=91663) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:23:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:23:38 devstack cinder-volume[91663]: INFO cinder.keymgr.migration [None req-f59993b9-b6d6-4a81-816f-e0c4749d65f6 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 18 11:23:38 devstack sudo[91670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:23:38 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:23:39 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root
Jun 18 11:23:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.617s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:23:39 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:23:39 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Driver initialization completed successfully.
Jun 18 11:23:39 devstack cinder-volume[91663]: INFO cinder.manager [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Initiating service 3 cleanup
Jun 18 11:23:39 devstack cinder-volume[91663]: INFO cinder.manager [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Service 3 cleanup completed.
Jun 18 11:23:39 devstack cinder-volume[91663]: DEBUG cinder.service [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Creating RPC server for service cinder-volume {{(pid=91663) start /opt/stack/cinder/cinder/service.py:231}}
Jun 18 11:23:39 devstack cinder-volume[91663]: DEBUG cinder.service [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=91663) start /opt/stack/cinder/cinder/service.py:237}}
Jun 18 11:23:39 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 18 11:23:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:23:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:23:39 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:23:39 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:23:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:23:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:23:39 devstack sudo[91676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:23:39 devstack sudo[91676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:23:40 devstack sudo[91676]: pam_unix(sudo:session): session closed for user root
Jun 18 11:23:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.642s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:23:40 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-ac45390d-1873-4b91-b38e-69a90643d939 None None] Driver post RPC initialization completed successfully.
Jun 18 11:23:47 devstack cinder-volume[91417]: DEBUG dbcounter [-] [91417] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=91417) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:23:48 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:23:50 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=4 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:24:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:24:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 6 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:24:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Flow 'volume_create_manager' (c5c9e013-13b4-4f40-b9cb-aa605ee6d43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb06bf22-2a88-46c7-aed6-364b1b87c61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb06bf22-2a88-46c7-aed6-364b1b87c61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-696599549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0de0c70-4e26-488f-adaa-35749cc2d34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea3076098634743aab837077eaace7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:24:57Z,use_quota=True,user_id='56cf70c2a11c442d804f527a3c7212b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea865cfa-096a-4a9a-904f-7bae87561f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea865cfa-096a-4a9a-904f-7bae87561f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f12fee1-8a6b-4eef-a2f1-a9eb4c4b5ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f12fee1-8a6b-4eef-a2f1-a9eb4c4b5ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0de0c70-4e26-488f-adaa-35749cc2d34e', 'volume_name': 'volume-e0de0c70-4e26-488f-adaa-35749cc2d34e', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f2031e-bae8-4b2d-bc16-7f4256daea02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f2031e-bae8-4b2d-bc16-7f4256daea02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1bb4bb-bdac-4d9b-ba08-5f80a4c711d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:24:57 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Volume e0de0c70-4e26-488f-adaa-35749cc2d34e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0de0c70-4e26-488f-adaa-35749cc2d34e', 'volume_size': 1}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-696599549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0de0c70-4e26-488f-adaa-35749cc2d34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea3076098634743aab837077eaace7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:24:57Z,use_quota=True,user_id='56cf70c2a11c442d804f527a3c7212b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Creating volume e0de0c70-4e26-488f-adaa-35749cc2d34e {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:24:57 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:24:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0de0c70-4e26-488f-adaa-35749cc2d34e 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:24:57 devstack sudo[92171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0de0c70-4e26-488f-adaa-35749cc2d34e 1073741824
Jun 18 11:24:57 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:24:59 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root
Jun 18 11:24:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0de0c70-4e26-488f-adaa-35749cc2d34e 1073741824" returned: 0 in 1.852s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:24:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0de0c70-4e26-488f-adaa-35749cc2d34e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:24:59 devstack sudo[92528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0de0c70-4e26-488f-adaa-35749cc2d34e
Jun 18 11:24:59 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:01 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0de0c70-4e26-488f-adaa-35749cc2d34e" returned: 0 in 2.358s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:25:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] <== create_volume: return (4325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:25:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.329s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:25:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1bb4bb-bdac-4d9b-ba08-5f80a4c711d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0de0c70-4e26-488f-adaa-35749cc2d34e', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497deb15-2f1d-4f2a-83d3-fb3f0ff4eddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:02 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Volume volume-e0de0c70-4e26-488f-adaa-35749cc2d34e (e0de0c70-4e26-488f-adaa-35749cc2d34e): created successfully
Jun 18 11:25:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497deb15-2f1d-4f2a-83d3-fb3f0ff4eddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Flow 'volume_create_manager' (c5c9e013-13b4-4f40-b9cb-aa605ee6d43e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:25:02 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-36e4ba32-dab5-4899-bca2-3fd496cad779 tempest-DeleteServersTestJSON-672800532 None] Created volume successfully.
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Flow 'volume_create_manager' (b7ab1efc-d10b-42ea-bdba-e9c58e5359c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddca7bb1-02f8-420a-97bb-0f3446a0da5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddca7bb1-02f8-420a-97bb-0f3446a0da5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1187551745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd6c58d-7433-4d9d-9993-213c85ecd561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bf648ac96b441980dd1ccdd34e35d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:25:05Z,use_quota=True,user_id='7805b0883e84443ab6c212378d9fbe9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6c70e0-51bd-4aeb-b51e-de683953bedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6c70e0-51bd-4aeb-b51e-de683953bedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4992cc-d925-4390-bdc2-22b7fd51971f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4992cc-d925-4390-bdc2-22b7fd51971f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dd6c58d-7433-4d9d-9993-213c85ecd561', 'volume_name': 'volume-6dd6c58d-7433-4d9d-9993-213c85ecd561', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20cabf48-3447-40f7-b7a4-d324783672f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20cabf48-3447-40f7-b7a4-d324783672f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d33efda-44ab-434a-9a52-bffaa6ff2411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:04 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Volume 6dd6c58d-7433-4d9d-9993-213c85ecd561: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dd6c58d-7433-4d9d-9993-213c85ecd561', 'volume_size': 1}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1187551745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd6c58d-7433-4d9d-9993-213c85ecd561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bf648ac96b441980dd1ccdd34e35d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:25:05Z,use_quota=True,user_id='7805b0883e84443ab6c212378d9fbe9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Creating volume 6dd6c58d-7433-4d9d-9993-213c85ecd561 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:25:04 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:25:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6dd6c58d-7433-4d9d-9993-213c85ecd561 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:25:04 devstack sudo[92928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6dd6c58d-7433-4d9d-9993-213c85ecd561 1073741824
Jun 18 11:25:04 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:06 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6dd6c58d-7433-4d9d-9993-213c85ecd561 1073741824" returned: 0 in 1.773s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:25:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6dd6c58d-7433-4d9d-9993-213c85ecd561 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:25:06 devstack sudo[92940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6dd6c58d-7433-4d9d-9993-213c85ecd561
Jun 18 11:25:06 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:08 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6dd6c58d-7433-4d9d-9993-213c85ecd561" returned: 0 in 1.719s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:25:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] <== create_volume: return (3627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:25:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.634s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:25:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d33efda-44ab-434a-9a52-bffaa6ff2411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd6c58d-7433-4d9d-9993-213c85ecd561', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758e79c2-933e-4f09-a9fc-b542a1d7bfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:08 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Volume volume-6dd6c58d-7433-4d9d-9993-213c85ecd561 (6dd6c58d-7433-4d9d-9993-213c85ecd561): created successfully
Jun 18 11:25:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758e79c2-933e-4f09-a9fc-b542a1d7bfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Flow 'volume_create_manager' (b7ab1efc-d10b-42ea-bdba-e9c58e5359c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:25:08 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-b8f19d04-97f4-4034-9ae5-5570011ca5cf tempest-VolumesAdminNegativeTest-289240432 None] Created volume successfully.
Jun 18 11:25:10 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Acquiring lock "cinder-6dd6c58d-7433-4d9d-9993-213c85ecd561-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:25:10 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Lock "cinder-6dd6c58d-7433-4d9d-9993-213c85ecd561-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:25:10 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Acquiring lock "cinder-quobyte-6dd6c58d-7433-4d9d-9993-213c85ecd561" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:25:10 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Lock "cinder-quobyte-6dd6c58d-7433-4d9d-9993-213c85ecd561" acquired by "delete_volume" :: waited 0.038s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:25:10 devstack cinder-volume[91663]: INFO oslo.privsep.daemon [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmptckqmcex/privsep.sock']
Jun 18 11:25:10 devstack sudo[93014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmptckqmcex/privsep.sock
Jun 18 11:25:10 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:11 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jun 18 11:25:11 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 18 11:25:11 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 18 11:25:11 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 18 11:25:11 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 18 11:25:11 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 18 11:25:11 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 18 11:25:11 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 18 11:25:11 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jun 18 11:25:12 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jun 18 11:25:12 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 18 11:25:12 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 18 11:25:12 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 18 11:25:12 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 18 11:25:12 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 18 11:25:12 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 18 11:25:12 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 18 11:25:12 devstack cinder-volume[91663]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jun 18 11:25:13 devstack cinder-volume[91663]: WARNING py.warnings [req-cba9b99e-7284-4245-9a7b-8b8738a6fbdb req-ce7cb2d4-7462-4184-b164-51832104c4c6 tempest-DeleteServersTestJSON-672800532 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Jun 18 11:25:13 devstack cinder-volume[91663]:   .first()
Jun 18 11:25:13 devstack cinder-volume[91663]: 
Jun 18 11:25:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-cba9b99e-7284-4245-9a7b-8b8738a6fbdb req-ce7cb2d4-7462-4184-b164-51832104c4c6 tempest-DeleteServersTestJSON-672800532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:25:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-cba9b99e-7284-4245-9a7b-8b8738a6fbdb req-ce7cb2d4-7462-4184-b164-51832104c4c6 tempest-DeleteServersTestJSON-672800532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:25:13 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:13 devstack cinder-volume[91663]: INFO oslo.privsep.daemon [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Spawned new privsep daemon via rootwrap
Jun 18 11:25:13 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Accepted privsep connection to /tmp/tmptckqmcex/privsep.sock {{(pid=91663) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jun 18 11:25:13 devstack cinder-volume[91663]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jun 18 11:25:13 devstack cinder-volume[91663]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jun 18 11:25:13 devstack cinder-volume[91663]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jun 18 11:25:13 devstack cinder-volume[91663]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 93026
Jun 18 11:25:13 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb7a8e3-80d8-4dbc-b1ec-1750d38d41c2]: (2,) {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:25:13 devstack cinder-volume[91663]: WARNING oslo_privsep.priv_context [req-cba9b99e-7284-4245-9a7b-8b8738a6fbdb req-ce7cb2d4-7462-4184-b164-51832104c4c6 tempest-DeleteServersTestJSON-672800532 None] privsep daemon already running
Jun 18 11:25:13 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca36909-be95-4a84-8d26-3e0dbe0ae62b]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:25:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6dd6c58d-7433-4d9d-9993-213c85ecd561 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:25:13 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d9806c-70dc-40b1-9c8d-9b310eb34dc1]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:25:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-cba9b99e-7284-4245-9a7b-8b8738a6fbdb req-ce7cb2d4-7462-4184-b164-51832104c4c6 tempest-DeleteServersTestJSON-672800532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0de0c70-4e26-488f-adaa-35749cc2d34e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:25:13 devstack sudo[93033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6dd6c58d-7433-4d9d-9993-213c85ecd561
Jun 18 11:25:13 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:13 devstack sudo[93034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0de0c70-4e26-488f-adaa-35749cc2d34e
Jun 18 11:25:13 devstack sudo[93034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:15 devstack sudo[93034]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-cba9b99e-7284-4245-9a7b-8b8738a6fbdb req-ce7cb2d4-7462-4184-b164-51832104c4c6 tempest-DeleteServersTestJSON-672800532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0de0c70-4e26-488f-adaa-35749cc2d34e" returned: 0 in 1.787s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:25:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-cba9b99e-7284-4245-9a7b-8b8738a6fbdb req-ce7cb2d4-7462-4184-b164-51832104c4c6 tempest-DeleteServersTestJSON-672800532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.054s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:25:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-cba9b99e-7284-4245-9a7b-8b8738a6fbdb req-ce7cb2d4-7462-4184-b164-51832104c4c6 tempest-DeleteServersTestJSON-672800532 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-e0de0c70-4e26-488f-adaa-35749cc2d34e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '87c258aa-2364-4e5c-a2fc-335fe8e95a39', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:25:15 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-cba9b99e-7284-4245-9a7b-8b8738a6fbdb req-ce7cb2d4-7462-4184-b164-51832104c4c6 tempest-DeleteServersTestJSON-672800532 None] attachment_update completed successfully.
Jun 18 11:25:15 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6dd6c58d-7433-4d9d-9993-213c85ecd561" returned: 0 in 2.566s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:25:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6dd6c58d-7433-4d9d-9993-213c85ecd561 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:25:15 devstack sudo[93062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6dd6c58d-7433-4d9d-9993-213c85ecd561
Jun 18 11:25:15 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:17 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6dd6c58d-7433-4d9d-9993-213c85ecd561" returned: 0 in 2.048s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:25:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Lock "cinder-quobyte-6dd6c58d-7433-4d9d-9993-213c85ecd561" released by "delete_volume" :: held 7.748s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:25:18 devstack cinder-volume[91663]: WARNING cinder.quota [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:25:18 devstack cinder-volume[91663]: WARNING cinder.quota [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:25:18 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Created reservations ['d2cb9f59-c62b-4858-a67f-0427d2c75bf0', '02d818f2-e8df-443f-bff5-bd749f587f3a', '3e35e9b3-be01-4fc1-b669-7957d543adc3', 'db8b6ed9-398b-493f-9f32-73ff7fcfffcd'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:25:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:25:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:25:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:25:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:25:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:25:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:25:18 devstack sudo[93537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:25:18 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:20 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.604s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:25:20 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:25:20 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Deleted volume successfully.
Jun 18 11:25:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-adc50485-78aa-46e7-9f35-d5b20dbfb2f7 tempest-VolumesAdminNegativeTest-289240432 None] Lock "cinder-6dd6c58d-7433-4d9d-9993-213c85ecd561-delete_volume" released by "delete_volume" :: held 10.227s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:25:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:25:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:25:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:25:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:25:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:25:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:25:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:25:25 devstack sudo[93678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:25:25 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:26 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.880s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:25:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:25:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:25:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 8 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:25:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:25:27 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-430664e3-ef2c-4110-bc14-73f9b7cc6d7e req-6ad7c802-2177-4b0a-9d2b-79ad514a84b4 tempest-DeleteServersTestJSON-672800532 None] Terminate volume connection completed successfully.
Jun 18 11:25:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-430664e3-ef2c-4110-bc14-73f9b7cc6d7e req-6ad7c802-2177-4b0a-9d2b-79ad514a84b4 tempest-DeleteServersTestJSON-672800532 None] Deleting attachment 87c258aa-2364-4e5c-a2fc-335fe8e95a39. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:25:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] Acquiring lock "cinder-e0de0c70-4e26-488f-adaa-35749cc2d34e-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:25:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] Lock "cinder-e0de0c70-4e26-488f-adaa-35749cc2d34e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:25:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] Acquiring lock "cinder-quobyte-e0de0c70-4e26-488f-adaa-35749cc2d34e" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:25:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] Lock "cinder-quobyte-e0de0c70-4e26-488f-adaa-35749cc2d34e" acquired by "delete_volume" :: waited 0.030s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:25:32 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c20478-d46b-477f-9f50-3fd60947a296]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:25:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0de0c70-4e26-488f-adaa-35749cc2d34e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:25:32 devstack sudo[93728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0de0c70-4e26-488f-adaa-35749cc2d34e
Jun 18 11:25:32 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:33 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0de0c70-4e26-488f-adaa-35749cc2d34e" returned: 0 in 1.170s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:25:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0de0c70-4e26-488f-adaa-35749cc2d34e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:25:33 devstack sudo[93734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0de0c70-4e26-488f-adaa-35749cc2d34e
Jun 18 11:25:33 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:34 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0de0c70-4e26-488f-adaa-35749cc2d34e" returned: 0 in 1.458s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:25:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] Lock "cinder-quobyte-e0de0c70-4e26-488f-adaa-35749cc2d34e" released by "delete_volume" :: held 2.683s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:25:35 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] Created reservations ['4ee7982c-6fdd-40b2-84a3-1da558502b10', '757e5ef2-e020-429f-bbf1-7c7792582e11', '533e0346-a231-47bc-b80c-c37a8b77251c', 'eb4ce3d7-ceba-44d3-9e07-531f310db952'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:25:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:25:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:25:35 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:25:35 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:25:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:25:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:25:35 devstack sudo[93770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:25:35 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:36 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.994s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:25:36 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:25:36 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] Deleted volume successfully.
Jun 18 11:25:36 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-92bb5fc8-f4f6-4523-b190-f822f82f8f15 tempest-DeleteServersTestJSON-672800532 None] Lock "cinder-e0de0c70-4e26-488f-adaa-35749cc2d34e-delete_volume" released by "delete_volume" :: held 3.970s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:25:45 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=18,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=2 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Flow 'volume_create_manager' (1c8cd263-2c2e-4eb7-8dc8-f1b3a0193324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d60b5de-a40d-4c86-8920-8e7c34cf2715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d60b5de-a40d-4c86-8920-8e7c34cf2715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1612136217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87018831-5330-4f5f-a5e8-6ae69f692b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da0086cfbdd4a638292262a0856fc25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:25:48Z,use_quota=True,user_id='75cfcb98e6bf405bb8116b6cfa9b0fd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb931e11-c481-4b2b-8a39-9da281ecd979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb931e11-c481-4b2b-8a39-9da281ecd979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64753ec7-fefb-4cdc-811a-5459885fcc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64753ec7-fefb-4cdc-811a-5459885fcc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87018831-5330-4f5f-a5e8-6ae69f692b8f', 'volume_name': 'volume-87018831-5330-4f5f-a5e8-6ae69f692b8f', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0acfd9c9-b2bf-4cd5-bdbf-9caf3af45791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0acfd9c9-b2bf-4cd5-bdbf-9caf3af45791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8427475f-6c64-4274-8182-c1c94d4d96bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:48 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Volume 87018831-5330-4f5f-a5e8-6ae69f692b8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87018831-5330-4f5f-a5e8-6ae69f692b8f', 'volume_size': 1}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1612136217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87018831-5330-4f5f-a5e8-6ae69f692b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da0086cfbdd4a638292262a0856fc25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:25:48Z,use_quota=True,user_id='75cfcb98e6bf405bb8116b6cfa9b0fd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Creating volume 87018831-5330-4f5f-a5e8-6ae69f692b8f {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:25:48 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:25:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-87018831-5330-4f5f-a5e8-6ae69f692b8f 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:25:48 devstack sudo[93821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-87018831-5330-4f5f-a5e8-6ae69f692b8f 1073741824
Jun 18 11:25:48 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:49 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-87018831-5330-4f5f-a5e8-6ae69f692b8f 1073741824" returned: 0 in 1.410s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:25:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-87018831-5330-4f5f-a5e8-6ae69f692b8f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:25:49 devstack sudo[93829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-87018831-5330-4f5f-a5e8-6ae69f692b8f
Jun 18 11:25:49 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Flow 'volume_create_manager' (d2ea4ec9-4268-4a4e-b2c6-3174698da82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85960db2-e037-438a-909d-96d6c008181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85960db2-e037-438a-909d-96d6c008181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1525604088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2edfba-a09d-4fd1-9b2e-8275bf9ed986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662a5dabc85f4483a22d2f68f87ecc5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:25:50Z,use_quota=True,user_id='05c873ca2d9b450699217a298a42e956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9056b29-c983-4e33-8436-b194a3a6bcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9056b29-c983-4e33-8436-b194a3a6bcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d08888-7161-4f14-a9f5-9d08fb5e0d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d08888-7161-4f14-a9f5-9d08fb5e0d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad2edfba-a09d-4fd1-9b2e-8275bf9ed986', 'volume_name': 'volume-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8da9cbd-bdc6-4b02-99af-d744c50f354c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8da9cbd-bdc6-4b02-99af-d744c50f354c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e55bfd-6e96-4466-8826-cd394aece773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:50 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Volume ad2edfba-a09d-4fd1-9b2e-8275bf9ed986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986', 'volume_size': 1}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:25:50 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-87018831-5330-4f5f-a5e8-6ae69f692b8f" returned: 0 in 0.809s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] <== create_volume: return (2287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.292s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.517s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1525604088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2edfba-a09d-4fd1-9b2e-8275bf9ed986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662a5dabc85f4483a22d2f68f87ecc5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:25:50Z,use_quota=True,user_id='05c873ca2d9b450699217a298a42e956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Creating volume ad2edfba-a09d-4fd1-9b2e-8275bf9ed986 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:25:50 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:25:50 devstack sudo[93833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986 1073741824
Jun 18 11:25:50 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8427475f-6c64-4274-8182-c1c94d4d96bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87018831-5330-4f5f-a5e8-6ae69f692b8f', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6dca3a-df31-4255-8b0e-77fe7e638355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=28,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=5 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:25:50 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Volume volume-87018831-5330-4f5f-a5e8-6ae69f692b8f (87018831-5330-4f5f-a5e8-6ae69f692b8f): created successfully
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6dca3a-df31-4255-8b0e-77fe7e638355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Flow 'volume_create_manager' (1c8cd263-2c2e-4eb7-8dc8-f1b3a0193324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:25:50 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-38dce36c-25ac-4dff-b54e-4b20d7f4d8dd tempest-TaggedAttachmentsTest-1913965373 None] Created volume successfully.
Jun 18 11:25:51 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986 1073741824" returned: 0 in 1.071s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:25:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:25:51 devstack sudo[93840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986
Jun 18 11:25:51 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:52 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986" returned: 0 in 0.833s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:25:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:25:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:25:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e55bfd-6e96-4466-8826-cd394aece773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6267861d-6d49-4143-be23-c9e60dd1c98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:52 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Volume volume-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986 (ad2edfba-a09d-4fd1-9b2e-8275bf9ed986): created successfully
Jun 18 11:25:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6267861d-6d49-4143-be23-c9e60dd1c98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Flow 'volume_create_manager' (d2ea4ec9-4268-4a4e-b2c6-3174698da82a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:25:52 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d999f4fd-6385-4b7c-a18c-32732f369424 tempest-ServersNegativeTestJSON-648020488 None] Created volume successfully.
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Flow 'volume_create_manager' (76de6b29-cff8-4fed-9924-7b3a6e477a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5174e12f-be4e-4b61-845f-fa502de5885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5174e12f-be4e-4b61-845f-fa502de5885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-677673443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3affb4e0-cca6-426a-a12e-33355f0fc8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662a5dabc85f4483a22d2f68f87ecc5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:25:56Z,use_quota=True,user_id='05c873ca2d9b450699217a298a42e956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785e6a49-2cd4-416b-ac11-d3f63d231689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785e6a49-2cd4-416b-ac11-d3f63d231689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9f0601-3345-4dd4-813d-99ba3e7b811a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9f0601-3345-4dd4-813d-99ba3e7b811a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3affb4e0-cca6-426a-a12e-33355f0fc8b2', 'volume_name': 'volume-3affb4e0-cca6-426a-a12e-33355f0fc8b2', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631615e7-2daa-4fb0-a7e6-db0f049902b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631615e7-2daa-4fb0-a7e6-db0f049902b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798eaeca-dba4-475c-bcb5-fc7ce3b31c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:56 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Volume 3affb4e0-cca6-426a-a12e-33355f0fc8b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3affb4e0-cca6-426a-a12e-33355f0fc8b2', 'volume_size': 1}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-677673443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3affb4e0-cca6-426a-a12e-33355f0fc8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662a5dabc85f4483a22d2f68f87ecc5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:25:56Z,use_quota=True,user_id='05c873ca2d9b450699217a298a42e956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Creating volume 3affb4e0-cca6-426a-a12e-33355f0fc8b2 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:25:56 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:25:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3affb4e0-cca6-426a-a12e-33355f0fc8b2 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:25:56 devstack sudo[93847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3affb4e0-cca6-426a-a12e-33355f0fc8b2 1073741824
Jun 18 11:25:56 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:57 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3affb4e0-cca6-426a-a12e-33355f0fc8b2 1073741824" returned: 0 in 1.093s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:25:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3affb4e0-cca6-426a-a12e-33355f0fc8b2 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:25:57 devstack sudo[93856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3affb4e0-cca6-426a-a12e-33355f0fc8b2
Jun 18 11:25:57 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:25:58 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root
Jun 18 11:25:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3affb4e0-cca6-426a-a12e-33355f0fc8b2" returned: 0 in 0.835s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:25:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:25:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:25:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798eaeca-dba4-475c-bcb5-fc7ce3b31c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3affb4e0-cca6-426a-a12e-33355f0fc8b2', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7b3c06-1a62-470f-a710-f40db65cea7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:25:58 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Volume volume-3affb4e0-cca6-426a-a12e-33355f0fc8b2 (3affb4e0-cca6-426a-a12e-33355f0fc8b2): created successfully
Jun 18 11:25:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7b3c06-1a62-470f-a710-f40db65cea7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:25:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Flow 'volume_create_manager' (76de6b29-cff8-4fed-9924-7b3a6e477a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:25:58 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-2f8fd1cb-9cf4-48db-a426-6957b0f236c0 tempest-ServersNegativeTestJSON-648020488 None] Created volume successfully.
Jun 18 11:26:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] Acquiring lock "cinder-3affb4e0-cca6-426a-a12e-33355f0fc8b2-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:26:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] Lock "cinder-3affb4e0-cca6-426a-a12e-33355f0fc8b2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:26:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] Acquiring lock "cinder-quobyte-3affb4e0-cca6-426a-a12e-33355f0fc8b2" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:26:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] Lock "cinder-quobyte-3affb4e0-cca6-426a-a12e-33355f0fc8b2" acquired by "delete_volume" :: waited 0.042s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:26:02 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[394f273c-8f48-4bc8-902f-77467faeb7f5]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:26:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3affb4e0-cca6-426a-a12e-33355f0fc8b2 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:02 devstack sudo[93863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3affb4e0-cca6-426a-a12e-33355f0fc8b2
Jun 18 11:26:02 devstack sudo[93863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:04 devstack sudo[93863]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3affb4e0-cca6-426a-a12e-33355f0fc8b2" returned: 0 in 1.409s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3affb4e0-cca6-426a-a12e-33355f0fc8b2 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:04 devstack sudo[93883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3affb4e0-cca6-426a-a12e-33355f0fc8b2
Jun 18 11:26:04 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:04 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3affb4e0-cca6-426a-a12e-33355f0fc8b2" returned: 0 in 0.799s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:04 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] Lock "cinder-quobyte-3affb4e0-cca6-426a-a12e-33355f0fc8b2" released by "delete_volume" :: held 2.295s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:26:04 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] Created reservations ['bfbb4a85-f1c5-4ca3-81c4-7c800e3b70d0', '5091663e-91ed-4618-b156-01e63bcb5669', 'f73c0cc2-f8cd-4f59-9210-e1f07996a155', 'a4c7cd68-d094-4bee-b402-927e88126a45'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:26:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:26:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:26:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:26:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:26:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:26:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:05 devstack sudo[93895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:26:05 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:05 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.630s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:05 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:26:05 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] Deleted volume successfully.
Jun 18 11:26:05 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-69d42794-fe90-4ba9-b2c6-aca7bd75e404 tempest-ServersNegativeTestJSON-648020488 None] Lock "cinder-3affb4e0-cca6-426a-a12e-33355f0fc8b2-delete_volume" released by "delete_volume" :: held 3.240s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:26:05 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] Acquiring lock "cinder-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:26:05 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] Lock "cinder-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:26:05 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] Acquiring lock "cinder-quobyte-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:26:05 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] Lock "cinder-quobyte-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986" acquired by "delete_volume" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:26:06 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[34abc38d-4270-462d-8892-3e2bf7021e6b]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:26:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:06 devstack sudo[93898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986
Jun 18 11:26:06 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:06 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986" returned: 0 in 0.837s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:06 devstack sudo[93903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986
Jun 18 11:26:06 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:07 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986" returned: 0 in 0.801s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] Lock "cinder-quobyte-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986" released by "delete_volume" :: held 1.719s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:26:07 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] Created reservations ['6d8c7815-91da-4355-8f8f-3f69da5967f5', 'a8de94bd-db69-419a-8d47-666391f6939f', '7da0320f-c476-435d-a871-e9df9fd49166', '4c26c63e-f9ba-4629-affa-260beb064b6a'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:26:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:26:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:26:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:26:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:26:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:26:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:07 devstack sudo[93908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:26:07 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:08 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.035s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:08 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:26:08 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] Deleted volume successfully.
Jun 18 11:26:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7cc7773b-e743-490f-b786-486c1e137324 tempest-ServersNegativeTestJSON-648020488 None] Lock "cinder-ad2edfba-a09d-4fd1-9b2e-8275bf9ed986-delete_volume" released by "delete_volume" :: held 3.077s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:26:17 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=15,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=1 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:26:18 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:UPDATE=22,cinder:INSERT=3,cinder:DELETE=4,cinder:SELECT=13 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:26:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:26:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:26:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:26:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:26:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:26:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:26:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:25 devstack sudo[94195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:26:25 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:26 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.120s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Flow 'volume_create_manager' (8accbe25-bb47-4d81-9094-a7e9d222a466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2403a989-73d0-4921-8573-e47c960e89c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2403a989-73d0-4921-8573-e47c960e89c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1843726343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b8b359-5aea-4348-8f29-edd993ac2918,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='43fef2fd976b431faba4ba3aba13cf07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:26:29Z,use_quota=True,user_id='998385c9b8e24232b070925dd9586b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06c7501-82a3-4e5b-8e92-71c7577e3493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06c7501-82a3-4e5b-8e92-71c7577e3493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d3cd7f-fcdd-4687-9359-d85d2341c08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d3cd7f-fcdd-4687-9359-d85d2341c08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b8b359-5aea-4348-8f29-edd993ac2918', 'volume_name': 'volume-72b8b359-5aea-4348-8f29-edd993ac2918', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f6fa6e-c81b-4db0-a78b-0a1e175569b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f6fa6e-c81b-4db0-a78b-0a1e175569b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af141cca-df06-4b32-9e1b-a98696db4843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:29 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Volume 72b8b359-5aea-4348-8f29-edd993ac2918: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b8b359-5aea-4348-8f29-edd993ac2918', 'volume_size': 1}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1843726343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b8b359-5aea-4348-8f29-edd993ac2918,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='43fef2fd976b431faba4ba3aba13cf07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:26:29Z,use_quota=True,user_id='998385c9b8e24232b070925dd9586b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Creating volume 72b8b359-5aea-4348-8f29-edd993ac2918 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:26:29 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:26:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-72b8b359-5aea-4348-8f29-edd993ac2918 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:29 devstack sudo[94301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-72b8b359-5aea-4348-8f29-edd993ac2918 1073741824
Jun 18 11:26:29 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:31 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-72b8b359-5aea-4348-8f29-edd993ac2918 1073741824" returned: 0 in 1.978s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-72b8b359-5aea-4348-8f29-edd993ac2918 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:31 devstack sudo[94432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-72b8b359-5aea-4348-8f29-edd993ac2918
Jun 18 11:26:31 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:32 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-72b8b359-5aea-4348-8f29-edd993ac2918" returned: 0 in 1.553s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:32 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] <== create_volume: return (3677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:26:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.683s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:26:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af141cca-df06-4b32-9e1b-a98696db4843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b8b359-5aea-4348-8f29-edd993ac2918', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2720d158-6dfc-4e87-9098-297543102daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:32 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Volume volume-72b8b359-5aea-4348-8f29-edd993ac2918 (72b8b359-5aea-4348-8f29-edd993ac2918): created successfully
Jun 18 11:26:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2720d158-6dfc-4e87-9098-297543102daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Flow 'volume_create_manager' (8accbe25-bb47-4d81-9094-a7e9d222a466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:26:33 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-2c0ee7bb-1ffb-44a8-ab29-65527f1143f8 req-92a32609-edc0-4a4e-9a23-e374d750ae84 tempest-VolumesGetTestJSON-683095039 None] Created volume successfully.
Jun 18 11:26:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] Acquiring lock "cinder-72b8b359-5aea-4348-8f29-edd993ac2918-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:26:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] Lock "cinder-72b8b359-5aea-4348-8f29-edd993ac2918-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:26:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] Acquiring lock "cinder-quobyte-72b8b359-5aea-4348-8f29-edd993ac2918" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:26:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] Lock "cinder-quobyte-72b8b359-5aea-4348-8f29-edd993ac2918" acquired by "delete_volume" :: waited 0.030s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:26:34 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aa9cf9-231c-4d05-8227-593b8b9d0a10]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:26:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-72b8b359-5aea-4348-8f29-edd993ac2918 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:34 devstack sudo[94462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-72b8b359-5aea-4348-8f29-edd993ac2918
Jun 18 11:26:34 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:36 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-72b8b359-5aea-4348-8f29-edd993ac2918" returned: 0 in 1.648s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-72b8b359-5aea-4348-8f29-edd993ac2918 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:36 devstack sudo[94468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-72b8b359-5aea-4348-8f29-edd993ac2918
Jun 18 11:26:36 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:37 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-72b8b359-5aea-4348-8f29-edd993ac2918" returned: 0 in 1.216s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] Lock "cinder-quobyte-72b8b359-5aea-4348-8f29-edd993ac2918" released by "delete_volume" :: held 2.976s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:26:37 devstack cinder-volume[91663]: DEBUG cinder.quota [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] Created reservations ['a21f1d7a-8b5e-4448-8049-9e1beb76eda0', '05f12307-d85e-469b-b759-3f47b52f2f91', 'c1b34147-58a0-40f1-95a7-4930b8963c9b', 'b24c6379-4c62-450b-838b-35f21835430c'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:26:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:26:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:26:37 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:26:37 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:26:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:26:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:37 devstack sudo[94472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:26:37 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:39 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.712s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:39 devstack cinder-volume[91663]: DEBUG cinder.manager [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:26:39 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] Deleted volume successfully.
Jun 18 11:26:39 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-41f38422-fc71-455e-b05b-1d201fbbd4e1 req-7d9a068e-914d-4c58-aafb-b52c033d57ab tempest-VolumesGetTestJSON-683095039 None] Lock "cinder-72b8b359-5aea-4348-8f29-edd993ac2918-delete_volume" released by "delete_volume" :: held 5.249s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:26:47 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:UPDATE=10,cinder:SELECT=10,cinder:INSERT=2 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:26:49 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=4,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=2 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:26:50 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-6221e89a-c8ff-48de-889f-ba602c183bde tempest-GroupSnapshotsV319Test-332082677 None] Group tempest-GroupSnapshotsV319Test-Group-936964333: creating
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Flow 'volume_create_manager' (6e269d91-5ccf-4556-b630-3dbff7db0ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d3f63d-4251-4089-9321-1d008507c183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:50 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-6221e89a-c8ff-48de-889f-ba602c183bde tempest-GroupSnapshotsV319Test-332082677 None] Group tempest-GroupSnapshotsV319Test-Group-936964333: created successfully
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d3f63d-4251-4089-9321-1d008507c183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1831771302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba0f1101-dc1b-473f-bcdc-20723f452f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53aecef7831f495fad09fc787e9bd98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:26:50Z,use_quota=True,user_id='1bbb59fc269249309beb5fb947d67f66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54986d53-28be-4117-bf51-13d692ca9f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54986d53-28be-4117-bf51-13d692ca9f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad5c039-1d64-490c-b8ae-72f9f549b949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad5c039-1d64-490c-b8ae-72f9f549b949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba0f1101-dc1b-473f-bcdc-20723f452f0c', 'volume_name': 'volume-ba0f1101-dc1b-473f-bcdc-20723f452f0c', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8f1d4c-4a0c-4ed1-a5e0-f86945cb7548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8f1d4c-4a0c-4ed1-a5e0-f86945cb7548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7150189d-00ad-4aa8-b0a7-7daab3c2063b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:50 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Volume ba0f1101-dc1b-473f-bcdc-20723f452f0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba0f1101-dc1b-473f-bcdc-20723f452f0c', 'volume_size': 1}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1831771302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba0f1101-dc1b-473f-bcdc-20723f452f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53aecef7831f495fad09fc787e9bd98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:26:50Z,use_quota=True,user_id='1bbb59fc269249309beb5fb947d67f66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Creating volume ba0f1101-dc1b-473f-bcdc-20723f452f0c {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:26:50 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:26:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba0f1101-dc1b-473f-bcdc-20723f452f0c 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:50 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-6221e89a-c8ff-48de-889f-ba602c183bde tempest-GroupSnapshotsV319Test-332082677 None] Create group completed successfully.
Jun 18 11:26:50 devstack sudo[94675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba0f1101-dc1b-473f-bcdc-20723f452f0c 1073741824
Jun 18 11:26:50 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:51 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba0f1101-dc1b-473f-bcdc-20723f452f0c 1073741824" returned: 0 in 0.987s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba0f1101-dc1b-473f-bcdc-20723f452f0c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:51 devstack sudo[94701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba0f1101-dc1b-473f-bcdc-20723f452f0c
Jun 18 11:26:51 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Flow 'volume_create_manager' (9310e353-09b3-489b-a376-db436055bc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6f381b-913e-4b09-b917-c8c480d54559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6f381b-913e-4b09-b917-c8c480d54559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2063376260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=05b63e1e-f7a0-49aa-83a6-4487de4c05bf,host='devstack@QuobyteHD#QuobyteHD',id=b32e6ca5-0f21-42ef-b653-e1b81fef0b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82fbe802e9e044a3837eeada25e1ee39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:26:52Z,use_quota=True,user_id='a2995e8ed4194cb095a1c144c50f530b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bf4cfb0-5a07-4e1e-99bc-b6e528475caf),volume_type_id=4bf4cfb0-5a07-4e1e-99bc-b6e528475caf)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4667c600-f4e3-4a97-8235-b26c9d9495ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4667c600-f4e3-4a97-8235-b26c9d9495ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29f829e-e87c-4d1c-92de-80898b931dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29f829e-e87c-4d1c-92de-80898b931dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b32e6ca5-0f21-42ef-b653-e1b81fef0b76', 'volume_name': 'volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2212432f-3f57-41ab-aa89-4216131898cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2212432f-3f57-41ab-aa89-4216131898cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f8c285-dd8f-4363-af3d-482fefeceae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:52 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Volume b32e6ca5-0f21-42ef-b653-e1b81fef0b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76', 'volume_size': 1}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:26:52 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba0f1101-dc1b-473f-bcdc-20723f452f0c" returned: 0 in 0.746s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.293s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=05b63e1e-f7a0-49aa-83a6-4487de4c05bf,created_at=2026-06-18T09:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2063376260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=05b63e1e-f7a0-49aa-83a6-4487de4c05bf,host='devstack@QuobyteHD#QuobyteHD',id=b32e6ca5-0f21-42ef-b653-e1b81fef0b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82fbe802e9e044a3837eeada25e1ee39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:26:52Z,use_quota=True,user_id='a2995e8ed4194cb095a1c144c50f530b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bf4cfb0-5a07-4e1e-99bc-b6e528475caf),volume_type_id=4bf4cfb0-5a07-4e1e-99bc-b6e528475caf)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Creating volume b32e6ca5-0f21-42ef-b653-e1b81fef0b76 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:26:52 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:52 devstack sudo[94704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76 1073741824
Jun 18 11:26:52 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7150189d-00ad-4aa8-b0a7-7daab3c2063b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba0f1101-dc1b-473f-bcdc-20723f452f0c', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe5423e-3987-462c-afee-3e978fb95c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:52 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Volume volume-ba0f1101-dc1b-473f-bcdc-20723f452f0c (ba0f1101-dc1b-473f-bcdc-20723f452f0c): created successfully
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe5423e-3987-462c-afee-3e978fb95c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Flow 'volume_create_manager' (6e269d91-5ccf-4556-b630-3dbff7db0ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:26:52 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-31040e71-d48c-46ed-8aef-8d6ecb52d800 tempest-ServerRescueNegativeTestJSON-1616042012 None] Created volume successfully.
Jun 18 11:26:53 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76 1073741824" returned: 0 in 0.900s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:53 devstack sudo[94710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76
Jun 18 11:26:53 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:54 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76" returned: 0 in 0.769s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:54 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:26:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:26:54 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f8c285-dd8f-4363-af3d-482fefeceae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:54 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38826795-498b-4634-8da5-cc9b70e81029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:26:54 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Volume volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76 (b32e6ca5-0f21-42ef-b653-e1b81fef0b76): created successfully
Jun 18 11:26:54 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38826795-498b-4634-8da5-cc9b70e81029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:26:54 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Flow 'volume_create_manager' (9310e353-09b3-489b-a376-db436055bc2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:26:54 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-1f951999-8f5f-46ab-8127-e456380c3477 tempest-GroupSnapshotsV319Test-332082677 None] Created volume successfully.
Jun 18 11:26:55 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] GroupSnapshot 8cfac7b9-4429-4ebd-b892-e4262b3c4789: creating.
Jun 18 11:26:55 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] Group snapshot 8cfac7b9-4429-4ebd-b892-e4262b3c4789: creating. {{(pid=91663) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 18 11:26:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:26:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:26:55 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] Creating offline snapshot 7609e980-e3b2-43b5-8eb1-070104c367ca of volume b32e6ca5-0f21-42ef-b653-e1b81fef0b76 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:26:55 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd7ec60-e3f2-400a-a55f-0e19a7ab6a13]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:26:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:55 devstack sudo[94759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76
Jun 18 11:26:55 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:56 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76" returned: 0 in 1.055s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:56 devstack sudo[94770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca 1G
Jun 18 11:26:56 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:57 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca 1G" returned: 0 in 0.931s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:57 devstack sudo[94776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca
Jun 18 11:26:57 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:58 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca" returned: 0 in 1.057s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:58 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca is being set with open permissions: ugo+rw: NotImplementedError
Jun 18 11:26:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:58 devstack sudo[94813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca
Jun 18 11:26:58 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:26:59 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root
Jun 18 11:26:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca" returned: 0 in 1.188s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:26:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:26:59 devstack sudo[94832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.info
Jun 18 11:26:59 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:00 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.info" returned: 0 in 0.672s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:00 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 18 11:27:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:00 devstack sudo[94837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.info
Jun 18 11:27:00 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:01 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.info" returned: 0 in 0.777s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.874s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:27:01 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-64bb445b-3c35-4ed5-9e31-435fd9db1a1c tempest-GroupSnapshotsV319Test-332082677 None] group_snapshot 8cfac7b9-4429-4ebd-b892-e4262b3c4789: created successfully
Jun 18 11:27:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-d7802266-9204-487e-8585-222395d33e04 req-ce0f13b1-4afe-4137-91a8-125b91ab700d tempest-TaggedAttachmentsTest-1913965373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:27:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-d7802266-9204-487e-8585-222395d33e04 req-ce0f13b1-4afe-4137-91a8-125b91ab700d tempest-TaggedAttachmentsTest-1913965373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:27:02 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26ab58b-4593-4a07-8373-a738c6d96877]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:27:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-d7802266-9204-487e-8585-222395d33e04 req-ce0f13b1-4afe-4137-91a8-125b91ab700d tempest-TaggedAttachmentsTest-1913965373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-87018831-5330-4f5f-a5e8-6ae69f692b8f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:02 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] group_snapshot 8cfac7b9-4429-4ebd-b892-e4262b3c4789: deleting
Jun 18 11:27:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] group_snapshot 8cfac7b9-4429-4ebd-b892-e4262b3c4789: deleting {{(pid=91663) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 18 11:27:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] Acquiring lock "cinder-quobyte-b32e6ca5-0f21-42ef-b653-e1b81fef0b76" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:27:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] Lock "cinder-quobyte-b32e6ca5-0f21-42ef-b653-e1b81fef0b76" acquired by "delete_snapshot" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:27:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] Acquiring lock "cinder-quobyte-7609e980-e3b2-43b5-8eb1-070104c367ca" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:27:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] Lock "cinder-quobyte-7609e980-e3b2-43b5-8eb1-070104c367ca" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:27:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] Deleting offline snapshot 7609e980-e3b2-43b5-8eb1-070104c367ca of volume b32e6ca5-0f21-42ef-b653-e1b81fef0b76 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:27:02 devstack sudo[94877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-87018831-5330-4f5f-a5e8-6ae69f692b8f
Jun 18 11:27:02 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] snapshot_file for this snap is: volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:27:02 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c1a0f6-f3b5-45a1-83a9-53d78ea0cf6b]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:27:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:02 devstack sudo[94879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca
Jun 18 11:27:02 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:03 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-d7802266-9204-487e-8585-222395d33e04 req-ce0f13b1-4afe-4137-91a8-125b91ab700d tempest-TaggedAttachmentsTest-1913965373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-87018831-5330-4f5f-a5e8-6ae69f692b8f" returned: 0 in 0.799s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-d7802266-9204-487e-8585-222395d33e04 req-ce0f13b1-4afe-4137-91a8-125b91ab700d tempest-TaggedAttachmentsTest-1913965373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.823s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:27:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-d7802266-9204-487e-8585-222395d33e04 req-ce0f13b1-4afe-4137-91a8-125b91ab700d tempest-TaggedAttachmentsTest-1913965373 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-87018831-5330-4f5f-a5e8-6ae69f692b8f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e6fecd3-6fd3-427f-915b-d229e507df88', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:27:03 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-d7802266-9204-487e-8585-222395d33e04 req-ce0f13b1-4afe-4137-91a8-125b91ab700d tempest-TaggedAttachmentsTest-1913965373 None] attachment_update completed successfully.
Jun 18 11:27:03 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca" returned: 0 in 0.775s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:27:03 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d6f029-ef3a-47e0-880c-6b4cf8bfb23e]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:27:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:03 devstack sudo[94890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76
Jun 18 11:27:03 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:04 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76" returned: 0 in 0.972s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:04 devstack sudo[95314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca
Jun 18 11:27:04 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:05 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca" returned: 0 in 0.822s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:05 devstack sudo[95329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca
Jun 18 11:27:05 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:05 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76.7609e980-e3b2-43b5-8eb1-070104c367ca" returned: 0 in 0.797s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:06 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] Lock "cinder-quobyte-7609e980-e3b2-43b5-8eb1-070104c367ca" released by "_delete_snapshot" :: held 3.489s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:27:06 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] Lock "cinder-quobyte-b32e6ca5-0f21-42ef-b653-e1b81fef0b76" released by "delete_snapshot" :: held 3.514s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:27:06 devstack cinder-volume[91663]: WARNING cinder.quota [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1864755319 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1864755319, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:27:06 devstack cinder-volume[91663]: WARNING cinder.quota [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1864755319 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1864755319, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:27:06 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] Created reservations ['c1930c28-4706-484d-9e5e-9c535fa50be0', '05d65961-f5e9-4f6a-a837-b65b28d6f99a', '51cc5776-b44d-4655-ad2e-1cfd8f0ba5c2', 'ca931041-c0a2-4fc7-b7d6-324706c66315'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:27:06 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-418142c9-ed41-47ea-99a6-36d1a811f89a tempest-GroupSnapshotsV319Test-332082677 None] group_snapshot 8cfac7b9-4429-4ebd-b892-e4262b3c4789: deleted successfully
Jun 18 11:27:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] Acquiring lock "cinder-quobyte-b32e6ca5-0f21-42ef-b653-e1b81fef0b76" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:27:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] Lock "cinder-quobyte-b32e6ca5-0f21-42ef-b653-e1b81fef0b76" acquired by "delete_volume" :: waited 0.023s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:27:07 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[840aa9fd-a9bc-47cd-854d-6944c1504d64]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:27:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:07 devstack sudo[95338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76
Jun 18 11:27:07 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:08 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76" returned: 0 in 0.938s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:08 devstack sudo[95374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76
Jun 18 11:27:08 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:09 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b32e6ca5-0f21-42ef-b653-e1b81fef0b76" returned: 0 in 1.161s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] Lock "cinder-quobyte-b32e6ca5-0f21-42ef-b653-e1b81fef0b76" released by "delete_volume" :: held 2.209s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:27:09 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] Created reservations ['8b4c10f4-945d-4fdd-80f3-15c6c89455e7'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:27:09 devstack cinder-volume[91663]: WARNING cinder.quota [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1864755319 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1864755319, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:27:09 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] Created reservations ['5b7a50cb-25d4-4dee-8900-3612f74b80f5', 'e627b876-0e40-4543-84cb-38c68a56c66b', 'c391075c-a93f-4e8d-a601-08fd1f48593d', '1c73bd1d-2c94-4f3b-a2e2-5d6a68581714'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:27:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:27:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:27:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:27:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:27:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:27:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:10 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-01c9b517-449b-45de-808d-204a62f2b5a8 req-96a32664-576d-4122-8dbb-1d6aedc330f0 tempest-TaggedAttachmentsTest-1913965373 None] Terminate volume connection completed successfully.
Jun 18 11:27:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-01c9b517-449b-45de-808d-204a62f2b5a8 req-96a32664-576d-4122-8dbb-1d6aedc330f0 tempest-TaggedAttachmentsTest-1913965373 None] Deleting attachment 6e6fecd3-6fd3-427f-915b-d229e507df88. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:27:10 devstack sudo[95452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:27:10 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:11 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.801s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:11 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:27:11 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-fd6fc5e7-38d5-4639-ab8f-f1e020c70e29 tempest-GroupSnapshotsV319Test-332082677 None] Delete group completed successfully.
Jun 18 11:27:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] Acquiring lock "cinder-ba0f1101-dc1b-473f-bcdc-20723f452f0c-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:27:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] Lock "cinder-ba0f1101-dc1b-473f-bcdc-20723f452f0c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:27:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] Acquiring lock "cinder-quobyte-ba0f1101-dc1b-473f-bcdc-20723f452f0c" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:27:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] Lock "cinder-quobyte-ba0f1101-dc1b-473f-bcdc-20723f452f0c" acquired by "delete_volume" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:27:12 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfe6465-b3f6-4def-bfd1-9dbe56cc597e]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:27:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba0f1101-dc1b-473f-bcdc-20723f452f0c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:12 devstack sudo[95494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba0f1101-dc1b-473f-bcdc-20723f452f0c
Jun 18 11:27:12 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:13 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba0f1101-dc1b-473f-bcdc-20723f452f0c" returned: 0 in 1.271s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba0f1101-dc1b-473f-bcdc-20723f452f0c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:13 devstack sudo[95514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba0f1101-dc1b-473f-bcdc-20723f452f0c
Jun 18 11:27:13 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:14 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba0f1101-dc1b-473f-bcdc-20723f452f0c" returned: 0 in 0.906s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] Lock "cinder-quobyte-ba0f1101-dc1b-473f-bcdc-20723f452f0c" released by "delete_volume" :: held 2.249s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:27:14 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] Created reservations ['edf6fe56-065c-48d9-95b2-f4119a073335', '1f8df285-e5d2-4521-af84-d4cf214d37bc', '40402fb3-0162-45c0-80b3-11d53d3ab995', 'cc24d0d0-f3bb-4a46-952d-bfdb9eeec3ef'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:27:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:27:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:27:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:27:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:27:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:27:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:14 devstack sudo[95525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:27:14 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:15 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.256s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:27:15 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] Deleted volume successfully.
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-67f64c13-bcf5-431a-9fe4-b8a768e3ad1c tempest-ServerRescueNegativeTestJSON-1616042012 None] Lock "cinder-ba0f1101-dc1b-473f-bcdc-20723f452f0c-delete_volume" released by "delete_volume" :: held 3.892s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Flow 'volume_create_manager' (26a683fb-859d-4fa9-9a0e-ed62274a6db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f68b70a-fa64-4640-9c22-5ec19fbd911a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f68b70a-fa64-4640-9c22-5ec19fbd911a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-273118168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78852d8-5a1d-4da1-b39e-fc035a6219d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80a7ad330334b76816aba0c1ef0484e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:27:16Z,use_quota=True,user_id='312ee39232f4474cad92c3090ee16ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5fbb7d5-c791-42db-998a-7a9f24ed04f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5fbb7d5-c791-42db-998a-7a9f24ed04f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f48052-1b80-4929-8adf-7e9355e2b15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f48052-1b80-4929-8adf-7e9355e2b15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b78852d8-5a1d-4da1-b39e-fc035a6219d1', 'volume_name': 'volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a011545-4bb5-49bf-beeb-8be8bbb2d31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a011545-4bb5-49bf-beeb-8be8bbb2d31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943b0ae2-40e2-4187-84cd-87eaccff5ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:27:15 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Volume b78852d8-5a1d-4da1-b39e-fc035a6219d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1', 'volume_size': 1}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-273118168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78852d8-5a1d-4da1-b39e-fc035a6219d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80a7ad330334b76816aba0c1ef0484e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:27:16Z,use_quota=True,user_id='312ee39232f4474cad92c3090ee16ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Creating volume b78852d8-5a1d-4da1-b39e-fc035a6219d1 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:27:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:27:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:27:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:27:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:27:16 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:27:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:16 devstack sudo[95534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1 1073741824
Jun 18 11:27:16 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:17 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1 1073741824" returned: 0 in 1.549s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:17 devstack sudo[95578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1
Jun 18 11:27:17 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:19 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1" returned: 0 in 1.350s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] <== create_volume: return (3028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:27:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.033s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:27:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943b0ae2-40e2-4187-84cd-87eaccff5ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:27:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec089c2c-f711-4372-a5d1-61b87c5fb82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:27:19 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Volume volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1 (b78852d8-5a1d-4da1-b39e-fc035a6219d1): created successfully
Jun 18 11:27:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec089c2c-f711-4372-a5d1-61b87c5fb82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:27:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Flow 'volume_create_manager' (26a683fb-859d-4fa9-9a0e-ed62274a6db4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:27:19 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-9d55aadd-4070-49cd-b333-d73be701901e tempest-AttachVolumeTestJSON-85158170 None] Created volume successfully.
Jun 18 11:27:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-ed2606ec-abd3-45f5-bfe9-9a56d5708593 req-c042705e-1ea7-4b27-bbef-5e5346c6cdd4 tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:27:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-ed2606ec-abd3-45f5-bfe9-9a56d5708593 req-c042705e-1ea7-4b27-bbef-5e5346c6cdd4 tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:27:24 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd30dee4-4a1d-4f5f-a8ac-e70855ace38b]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:27:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-ed2606ec-abd3-45f5-bfe9-9a56d5708593 req-c042705e-1ea7-4b27-bbef-5e5346c6cdd4 tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:24 devstack sudo[95650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1
Jun 18 11:27:24 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:25 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-ed2606ec-abd3-45f5-bfe9-9a56d5708593 req-c042705e-1ea7-4b27-bbef-5e5346c6cdd4 tempest-AttachVolumeTestJSON-85158170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1" returned: 0 in 0.882s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-ed2606ec-abd3-45f5-bfe9-9a56d5708593 req-c042705e-1ea7-4b27-bbef-5e5346c6cdd4 tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.921s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:27:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-ed2606ec-abd3-45f5-bfe9-9a56d5708593 req-c042705e-1ea7-4b27-bbef-5e5346c6cdd4 tempest-AttachVolumeTestJSON-85158170 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5c0c2b1-094d-404a-8439-6070e0509499', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:27:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:27:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:27:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:27:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:27:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:27:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:27:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:25 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-ed2606ec-abd3-45f5-bfe9-9a56d5708593 req-c042705e-1ea7-4b27-bbef-5e5346c6cdd4 tempest-AttachVolumeTestJSON-85158170 None] attachment_update completed successfully.
Jun 18 11:27:25 devstack sudo[95666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:27:25 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:26 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.078s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:27:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:27:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 8 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:27:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:27:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] Acquiring lock "cinder-87018831-5330-4f5f-a5e8-6ae69f692b8f-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:27:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] Lock "cinder-87018831-5330-4f5f-a5e8-6ae69f692b8f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:27:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] Acquiring lock "cinder-quobyte-87018831-5330-4f5f-a5e8-6ae69f692b8f" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:27:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] Lock "cinder-quobyte-87018831-5330-4f5f-a5e8-6ae69f692b8f" acquired by "delete_volume" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:27:30 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dadf102-5fac-436b-9444-c52426a7e7b2]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:27:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-87018831-5330-4f5f-a5e8-6ae69f692b8f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:31 devstack sudo[96084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-87018831-5330-4f5f-a5e8-6ae69f692b8f
Jun 18 11:27:31 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:31 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-87018831-5330-4f5f-a5e8-6ae69f692b8f" returned: 0 in 0.781s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-87018831-5330-4f5f-a5e8-6ae69f692b8f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:31 devstack sudo[96089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-87018831-5330-4f5f-a5e8-6ae69f692b8f
Jun 18 11:27:31 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:32 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-87018831-5330-4f5f-a5e8-6ae69f692b8f" returned: 0 in 0.956s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] Lock "cinder-quobyte-87018831-5330-4f5f-a5e8-6ae69f692b8f" released by "delete_volume" :: held 1.794s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:27:32 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] Created reservations ['c675c187-fca3-404c-bca5-afe0b5a2efc6', '5fa02630-2c98-44f6-80d6-a015a474618d', 'cfd27f1f-50c3-484e-8080-8d41caa39601', 'accc9672-074a-4ada-96b2-eae121d24862'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:27:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:27:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:27:32 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:27:32 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:27:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:27:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:32 devstack sudo[96131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:27:32 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:33 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.829s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:33 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:27:33 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] Deleted volume successfully.
Jun 18 11:27:33 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0d4ab1d2-6f9a-4d60-b727-eec6e0abe07a tempest-TaggedAttachmentsTest-1913965373 None] Lock "cinder-87018831-5330-4f5f-a5e8-6ae69f692b8f-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Flow 'volume_create_manager' (e2f56382-9f54-4568-af1a-f4b5f2bc7be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ca5480-a8a9-423a-9f04-24347b983d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ca5480-a8a9-423a-9f04-24347b983d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1560908368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c788402-a6b8-48db-ba5d-ef8a97bf2e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42dec65ab67941eb8f6486801be086b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:27:42Z,use_quota=True,user_id='8460e7a45cf6484d81e3984f85eeeebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c256850f-2e11-4f89-b383-08816006a9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c256850f-2e11-4f89-b383-08816006a9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9638ea88-8dbe-4747-aace-7170bef71707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9638ea88-8dbe-4747-aace-7170bef71707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c788402-a6b8-48db-ba5d-ef8a97bf2e66', 'volume_name': 'volume-7c788402-a6b8-48db-ba5d-ef8a97bf2e66', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57df92f5-245c-4c82-bb4b-cf2ee54f51ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57df92f5-245c-4c82-bb4b-cf2ee54f51ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0347da-a62e-4551-8f87-9953113f8b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:27:42 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Volume 7c788402-a6b8-48db-ba5d-ef8a97bf2e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c788402-a6b8-48db-ba5d-ef8a97bf2e66', 'volume_size': 1}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1560908368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c788402-a6b8-48db-ba5d-ef8a97bf2e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42dec65ab67941eb8f6486801be086b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:27:42Z,use_quota=True,user_id='8460e7a45cf6484d81e3984f85eeeebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Creating volume 7c788402-a6b8-48db-ba5d-ef8a97bf2e66 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:27:42 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:27:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7c788402-a6b8-48db-ba5d-ef8a97bf2e66 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:42 devstack sudo[96171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7c788402-a6b8-48db-ba5d-ef8a97bf2e66 1073741824
Jun 18 11:27:42 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:43 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7c788402-a6b8-48db-ba5d-ef8a97bf2e66 1073741824" returned: 0 in 1.163s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7c788402-a6b8-48db-ba5d-ef8a97bf2e66 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:43 devstack sudo[96246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7c788402-a6b8-48db-ba5d-ef8a97bf2e66
Jun 18 11:27:43 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:44 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7c788402-a6b8-48db-ba5d-ef8a97bf2e66" returned: 0 in 0.793s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:27:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:27:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0347da-a62e-4551-8f87-9953113f8b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c788402-a6b8-48db-ba5d-ef8a97bf2e66', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:27:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f04d37-f316-4624-9ab0-bfcfd33d6f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:27:44 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Volume volume-7c788402-a6b8-48db-ba5d-ef8a97bf2e66 (7c788402-a6b8-48db-ba5d-ef8a97bf2e66): created successfully
Jun 18 11:27:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f04d37-f316-4624-9ab0-bfcfd33d6f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:27:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Flow 'volume_create_manager' (e2f56382-9f54-4568-af1a-f4b5f2bc7be0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:27:44 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-5a0cd4b9-cec1-4401-a563-7a33d689b9a6 tempest-VolumesServicesTestJSON-1747154283 None] Created volume successfully.
Jun 18 11:27:45 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] Acquiring lock "cinder-7c788402-a6b8-48db-ba5d-ef8a97bf2e66-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:27:45 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] Lock "cinder-7c788402-a6b8-48db-ba5d-ef8a97bf2e66-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:27:45 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] Acquiring lock "cinder-quobyte-7c788402-a6b8-48db-ba5d-ef8a97bf2e66" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:27:45 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] Lock "cinder-quobyte-7c788402-a6b8-48db-ba5d-ef8a97bf2e66" acquired by "delete_volume" :: waited 0.028s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:27:45 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[1670ee16-da3e-45a6-9285-e96479e05e9d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:27:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7c788402-a6b8-48db-ba5d-ef8a97bf2e66 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:46 devstack sudo[96262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7c788402-a6b8-48db-ba5d-ef8a97bf2e66
Jun 18 11:27:46 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:47 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7c788402-a6b8-48db-ba5d-ef8a97bf2e66" returned: 0 in 1.144s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7c788402-a6b8-48db-ba5d-ef8a97bf2e66 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:47 devstack sudo[96644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7c788402-a6b8-48db-ba5d-ef8a97bf2e66
Jun 18 11:27:47 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:48 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7c788402-a6b8-48db-ba5d-ef8a97bf2e66" returned: 0 in 1.005s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:48 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] Lock "cinder-quobyte-7c788402-a6b8-48db-ba5d-ef8a97bf2e66" released by "delete_volume" :: held 2.242s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:27:48 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=57,cinder:UPDATE=53,cinder:DELETE=4,cinder:INSERT=8 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:27:48 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] Created reservations ['d7cd4819-e895-4b2c-a665-04a61b617c71', '0bd71922-ca7e-4a83-a7a7-8a580e133b5b', 'cff58e0b-61c4-42ee-97a7-44d57ebc9691', 'c8683f73-8392-4982-bce2-98123cbe6fed'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:27:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:27:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:27:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:27:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:27:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:27:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:27:48 devstack sudo[96656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:27:48 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:27:49 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root
Jun 18 11:27:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.280s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:27:49 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:27:49 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] Deleted volume successfully.
Jun 18 11:27:49 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9a114dbc-5705-45a4-9bc0-ccac03dba432 tempest-VolumesServicesTestJSON-1747154283 None] Lock "cinder-7c788402-a6b8-48db-ba5d-ef8a97bf2e66-delete_volume" released by "delete_volume" :: held 3.988s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:27:58 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=59,cinder:UPDATE=57,cinder:INSERT=17,cinder:DELETE=2 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:27:59 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:INSERT=1,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Flow 'volume_create_manager' (d5de9492-d9c1-411c-ad92-af017b598975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ad80b0-56d3-4ac9-a2d5-89cffed74794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ad80b0-56d3-4ac9-a2d5-89cffed74794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1577969901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06699c4e-8281-4182-816e-5d57764cf008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9330b680a26f4fc68f766bbc223434a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:28:02Z,use_quota=True,user_id='bdd79a495ae445e287dd622a395a62e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce980698-512d-4241-9469-b6f6a7f44480),volume_type_id=ce980698-512d-4241-9469-b6f6a7f44480)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf7cc3d-f570-4776-b158-d9e5ce4d9ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf7cc3d-f570-4776-b158-d9e5ce4d9ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990f0b62-fcdc-4cfd-a147-3882ee3ecf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990f0b62-fcdc-4cfd-a147-3882ee3ecf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06699c4e-8281-4182-816e-5d57764cf008', 'volume_name': 'volume-06699c4e-8281-4182-816e-5d57764cf008', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c14620-ce2a-4c66-a17b-b6f29b292ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c14620-ce2a-4c66-a17b-b6f29b292ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72be46e1-5dc8-48ac-8dfa-41aa6a30844b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:02 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Volume 06699c4e-8281-4182-816e-5d57764cf008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06699c4e-8281-4182-816e-5d57764cf008', 'volume_size': 1}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1577969901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06699c4e-8281-4182-816e-5d57764cf008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9330b680a26f4fc68f766bbc223434a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:28:02Z,use_quota=True,user_id='bdd79a495ae445e287dd622a395a62e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce980698-512d-4241-9469-b6f6a7f44480),volume_type_id=ce980698-512d-4241-9469-b6f6a7f44480)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Creating volume 06699c4e-8281-4182-816e-5d57764cf008 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:28:02 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:28:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-06699c4e-8281-4182-816e-5d57764cf008 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:02 devstack sudo[96678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-06699c4e-8281-4182-816e-5d57764cf008 1073741824
Jun 18 11:28:02 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:03 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-06699c4e-8281-4182-816e-5d57764cf008 1073741824" returned: 0 in 0.951s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-06699c4e-8281-4182-816e-5d57764cf008 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:03 devstack sudo[96712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-06699c4e-8281-4182-816e-5d57764cf008
Jun 18 11:28:03 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:04 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-06699c4e-8281-4182-816e-5d57764cf008" returned: 0 in 0.683s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:04 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:28:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:28:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72be46e1-5dc8-48ac-8dfa-41aa6a30844b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06699c4e-8281-4182-816e-5d57764cf008', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c070da-24a6-4a7d-8c52-20d040997f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:04 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Volume volume-06699c4e-8281-4182-816e-5d57764cf008 (06699c4e-8281-4182-816e-5d57764cf008): created successfully
Jun 18 11:28:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c070da-24a6-4a7d-8c52-20d040997f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Flow 'volume_create_manager' (d5de9492-d9c1-411c-ad92-af017b598975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:28:04 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-2fce5015-d913-49b3-a2d4-24c80932bea4 tempest-VolumeTypesAccessTest-1057401317 None] Created volume successfully.
Jun 18 11:28:04 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Acquiring lock "cinder-06699c4e-8281-4182-816e-5d57764cf008-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:28:04 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Lock "cinder-06699c4e-8281-4182-816e-5d57764cf008-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:28:04 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Acquiring lock "cinder-quobyte-06699c4e-8281-4182-816e-5d57764cf008" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:28:04 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Lock "cinder-quobyte-06699c4e-8281-4182-816e-5d57764cf008" acquired by "delete_volume" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:28:04 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aa299f-b4fa-44ad-83c7-e7cecf01ac8d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:28:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-06699c4e-8281-4182-816e-5d57764cf008 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:04 devstack sudo[96721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-06699c4e-8281-4182-816e-5d57764cf008
Jun 18 11:28:04 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:05 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-06699c4e-8281-4182-816e-5d57764cf008" returned: 0 in 0.764s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-06699c4e-8281-4182-816e-5d57764cf008 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:05 devstack sudo[96726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-06699c4e-8281-4182-816e-5d57764cf008
Jun 18 11:28:05 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:06 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-06699c4e-8281-4182-816e-5d57764cf008" returned: 0 in 0.671s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:06 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Lock "cinder-quobyte-06699c4e-8281-4182-816e-5d57764cf008" released by "delete_volume" :: held 1.479s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:28:06 devstack cinder-volume[91663]: WARNING cinder.quota [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1050490110 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1050490110, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:28:06 devstack cinder-volume[91663]: WARNING cinder.quota [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1050490110 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1050490110, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:28:06 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Created reservations ['ea993d16-3a97-4088-b667-b95acb79b63f', '28e3d386-6263-4143-93e6-5300c2857d9c', 'f920f8b3-dc78-4306-a85b-11f4e470e4bd', 'ff78de1f-760d-4337-86d6-3fca612ca6a5'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:28:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:28:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:28:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:28:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:28:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:28:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:06 devstack sudo[96729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:28:06 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:07 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.714s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:07 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:28:07 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Deleted volume successfully.
Jun 18 11:28:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-110c12ef-9a59-4b75-9ea8-a8abc7efa2d5 tempest-VolumeTypesAccessTest-1057401317 None] Lock "cinder-06699c4e-8281-4182-816e-5d57764cf008-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:28:16 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-9db1cec4-b6da-413e-b968-c2310bb00b35 req-86778275-ebf9-4e87-a36f-2975e3a78398 tempest-AttachVolumeTestJSON-85158170 None] Terminate volume connection completed successfully.
Jun 18 11:28:16 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-9db1cec4-b6da-413e-b968-c2310bb00b35 req-86778275-ebf9-4e87-a36f-2975e3a78398 tempest-AttachVolumeTestJSON-85158170 None] Deleting attachment a5c0c2b1-094d-404a-8439-6070e0509499. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:28:23 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:28:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Flow 'volume_create_manager' (77091012-4f84-40a6-8718-c957e7b25200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:28:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab13a2c9-807e-4cf2-87da-192bacd41f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab13a2c9-807e-4cf2-87da-192bacd41f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-372558134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52e8a2b-6f2f-46f1-8735-a16f52d53186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabd59c80bf4de1bfd2c0df361b5faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:28:24Z,use_quota=True,user_id='04c2546c791d4681ad62d377c16a8c90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129346a0-dc41-43d7-8065-9768970b0b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129346a0-dc41-43d7-8065-9768970b0b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b63c48e-82ca-43e9-ad1e-90d0f9d58c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:24 devstack cinder-volume[91663]: DEBUG cinder.image.glance [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Creating Keystone auth plugin from conf {{(pid=91663) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 18 11:28:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b63c48e-82ca-43e9-ad1e-90d0f9d58c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c52e8a2b-6f2f-46f1-8735-a16f52d53186', 'volume_name': 'volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186', 'volume_size': 1, 'image_id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767e7f9d16154dd1a44a1bc208ee9108', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'created_at': datetime.datetime(2026, 6, 18, 9, 18, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 18, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ffb2e5520>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab80b65-d2b4-42a6-9f39-1f4bcb5d1e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab80b65-d2b4-42a6-9f39-1f4bcb5d1e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66126cc4-c764-45ca-a382-4bb37fd6c207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:24 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Volume c52e8a2b-6f2f-46f1-8735-a16f52d53186: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186', 'volume_size': 1, 'image_id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767e7f9d16154dd1a44a1bc208ee9108', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'created_at': datetime.datetime(2026, 6, 18, 9, 18, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 18, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ffb2e5520>}
Jun 18 11:28:24 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Trying to clone c52e8a2b-6f2f-46f1-8735-a16f52d53186 from image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 at location (None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}]). {{(pid=91663) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 18 11:28:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:28:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:28:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:28:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:28:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:28:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:28:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:25 devstack sudo[97035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:28:25 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:25 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_aznuzxzddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 18 11:28:25 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Image download 20.69 MB at 20.69 MB/s
Jun 18 11:28:25 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcee2b1-60ae-49eb-b76c-717363391472]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:28:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_aznuzxzddevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:25 devstack sudo[97037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_aznuzxzddevstack@QuobyteHD
Jun 18 11:28:25 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:26 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_aznuzxzddevstack@QuobyteHD" returned: 0 in 0.962s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:26 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Temporary image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 is fetched for user 04c2546c791d4681ad62d377c16a8c90. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 18 11:28:26 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.354s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:28:26 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3661d0c-b65e-4998-9661-06ec039944b6]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:28:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_aznuzxzddevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:28:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:28:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:28:27 devstack sudo[97045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_aznuzxzddevstack@QuobyteHD
Jun 18 11:28:27 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:27 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_aznuzxzddevstack@QuobyteHD" returned: 0 in 1.117s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:28:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:28:27 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-372558134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52e8a2b-6f2f-46f1-8735-a16f52d53186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabd59c80bf4de1bfd2c0df361b5faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:28:24Z,use_quota=True,user_id='04c2546c791d4681ad62d377c16a8c90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:28:27 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Creating volume c52e8a2b-6f2f-46f1-8735-a16f52d53186 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:28:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:28:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:28:27 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:28:27 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:28:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:28:27 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:28:27 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:28:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:27 devstack sudo[97052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186 1073741824
Jun 18 11:28:27 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:28 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186 1073741824" returned: 0 in 1.052s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:29 devstack sudo[97062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186
Jun 18 11:28:29 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:29 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186" returned: 0 in 0.627s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:28:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:28:29 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Attempting download of 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 ((None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}])) to volume c52e8a2b-6f2f-46f1-8735-a16f52d53186. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 18 11:28:29 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45c8294-7532-4abe-a093-4343a00ccfde]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:28:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_qbm7t4_x {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:29 devstack sudo[97065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_qbm7t4_x
Jun 18 11:28:29 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:30 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_qbm7t4_x" returned: 0 in 0.763s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_qbm7t4_x {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:30 devstack sudo[97081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_qbm7t4_x
Jun 18 11:28:30 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:31 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_qbm7t4_x" returned: 1 in 0.800s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_qbm7t4_x' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:28:31 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c00784a-bed6-4ddc-a7b8-ed735b97085f]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:28:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_aznuzxzddevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:31 devstack sudo[97092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_aznuzxzddevstack@QuobyteHD
Jun 18 11:28:31 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:32 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_aznuzxzddevstack@QuobyteHD" returned: 0 in 0.788s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:32 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 was qcow2, converting to raw {{(pid=91663) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 18 11:28:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_aznuzxzddevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:32 devstack sudo[97103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_aznuzxzddevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186
Jun 18 11:28:32 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:34 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_aznuzxzddevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186" returned: 0 in 2.675s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:34 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_aznuzxzddevstack@QuobyteHD, size 112.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186 {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:28:34 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Converted 112.00 MB image at 41.85 MB/s
Jun 18 11:28:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:34 devstack sudo[97182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186 1G
Jun 18 11:28:34 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:35 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186 1G" returned: 0 in 0.797s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:35 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c164a3-6140-45c4-8592-8e37995e8cc2]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:28:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:35 devstack sudo[97209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186
Jun 18 11:28:35 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:36 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186" returned: 0 in 0.887s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:36 devstack sudo[97213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186
Jun 18 11:28:36 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:37 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186" returned: 1 in 0.866s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:28:37 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Downloaded image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 ((None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}])) to volume c52e8a2b-6f2f-46f1-8735-a16f52d53186 successfully. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 18 11:28:37 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Temporary image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 for user 04c2546c791d4681ad62d377c16a8c90 is deleted. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 18 11:28:37 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Marking volume c52e8a2b-6f2f-46f1-8735-a16f52d53186 as bootable. {{(pid=91663) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 18 11:28:37 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Copying metadata from image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 to c52e8a2b-6f2f-46f1-8735-a16f52d53186. {{(pid=91663) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 18 11:28:37 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Creating volume glance metadata for volume c52e8a2b-6f2f-46f1-8735-a16f52d53186 backed by image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91663) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 18 11:28:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66126cc4-c764-45ca-a382-4bb37fd6c207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186', 'volume_size': 1, 'image_id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767e7f9d16154dd1a44a1bc208ee9108', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'created_at': datetime.datetime(2026, 6, 18, 9, 18, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 18, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ffb2e5520>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63386dd-c6ee-4d62-b3d6-9b7e37656af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:37 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Volume volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186 (c52e8a2b-6f2f-46f1-8735-a16f52d53186): created successfully
Jun 18 11:28:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63386dd-c6ee-4d62-b3d6-9b7e37656af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Flow 'volume_create_manager' (77091012-4f84-40a6-8718-c957e7b25200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:28:37 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-7ad6061e-716e-4f4f-9854-9ff2c8e1cdc3 tempest-VolumesImageMetadata-1961569639 None] Created volume successfully.
Jun 18 11:28:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Acquiring lock "cinder-c52e8a2b-6f2f-46f1-8735-a16f52d53186-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:28:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Lock "cinder-c52e8a2b-6f2f-46f1-8735-a16f52d53186-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:28:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Acquiring lock "cinder-quobyte-c52e8a2b-6f2f-46f1-8735-a16f52d53186" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:28:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Lock "cinder-quobyte-c52e8a2b-6f2f-46f1-8735-a16f52d53186" acquired by "delete_volume" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:28:38 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3079e71-52b8-4ff5-b820-05595006adfc]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:28:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:39 devstack sudo[97236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186
Jun 18 11:28:39 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:39 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186" returned: 0 in 0.803s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:39 devstack sudo[97246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186
Jun 18 11:28:39 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:40 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186" returned: 1 in 0.752s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:28:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:40 devstack sudo[97251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186
Jun 18 11:28:40 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:41 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c52e8a2b-6f2f-46f1-8735-a16f52d53186" returned: 0 in 0.643s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Lock "cinder-quobyte-c52e8a2b-6f2f-46f1-8735-a16f52d53186" released by "delete_volume" :: held 2.276s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:28:41 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Created reservations ['b4556b99-bc69-4496-b4ea-69bfe8717f6e', 'bb99514c-f959-4913-9c64-3cd56b72b8f8', 'ba866f6e-42c0-4386-b9a6-3a97cb947263', '4c1cede9-b2bf-453f-a3a6-9c2bbeb4d4cb'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:28:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:28:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:28:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:28:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:28:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:28:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:41 devstack sudo[97254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:28:41 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:41 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.671s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:41 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:28:41 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Deleted volume successfully.
Jun 18 11:28:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-29179c19-51c9-43af-b012-0fd3fc9eab7a tempest-VolumesImageMetadata-1961569639 None] Lock "cinder-c52e8a2b-6f2f-46f1-8735-a16f52d53186-delete_volume" released by "delete_volume" :: held 3.176s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Flow 'volume_create_manager' (a4d85465-2f25-44a0-99f1-2ae0dc041530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e557e2-5ebd-4595-abcc-3681b50a1bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e557e2-5ebd-4595-abcc-3681b50a1bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-582318375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3851e07-d523-44e0-9ea0-e25005e9fa97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb6fa69b6433ca38923d4961f63a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:28:44Z,use_quota=True,user_id='52ccb25475e344ef9b3ceedc0909c1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ca2cc1-d5a3-439f-8865-d953e240616b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ca2cc1-d5a3-439f-8865-d953e240616b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b950a952-7217-4170-9a10-b2076b23e7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b950a952-7217-4170-9a10-b2076b23e7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3851e07-d523-44e0-9ea0-e25005e9fa97', 'volume_name': 'volume-a3851e07-d523-44e0-9ea0-e25005e9fa97', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d371ea7-d005-4ecc-a260-33638b5d3509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d371ea7-d005-4ecc-a260-33638b5d3509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e7407a-2233-4662-8e86-72ddb6301bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:44 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Volume a3851e07-d523-44e0-9ea0-e25005e9fa97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3851e07-d523-44e0-9ea0-e25005e9fa97', 'volume_size': 1}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-582318375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3851e07-d523-44e0-9ea0-e25005e9fa97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb6fa69b6433ca38923d4961f63a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:28:44Z,use_quota=True,user_id='52ccb25475e344ef9b3ceedc0909c1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Creating volume a3851e07-d523-44e0-9ea0-e25005e9fa97 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:28:44 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:28:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3851e07-d523-44e0-9ea0-e25005e9fa97 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:44 devstack sudo[97259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3851e07-d523-44e0-9ea0-e25005e9fa97 1073741824
Jun 18 11:28:44 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:45 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3851e07-d523-44e0-9ea0-e25005e9fa97 1073741824" returned: 0 in 0.998s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3851e07-d523-44e0-9ea0-e25005e9fa97 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:45 devstack sudo[97266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3851e07-d523-44e0-9ea0-e25005e9fa97
Jun 18 11:28:45 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:45 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:28:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Flow 'volume_create_manager' (2f2a9e93-a0f9-445f-888a-c01993f57b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:28:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0817e621-3507-4821-80b2-799f0765693c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0817e621-3507-4821-80b2-799f0765693c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-76341023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f745249-8845-4175-acf2-56ec7967b9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fecb044bb23452994aa2d847c1bb086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:28:45Z,use_quota=True,user_id='626d3d3242794d90b41a1b9ad4678297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d91368-421e-460f-8bf6-ba10195253f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d91368-421e-460f-8bf6-ba10195253f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2395b155-e738-4a00-8e25-022655a76ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2395b155-e738-4a00-8e25-022655a76ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f745249-8845-4175-acf2-56ec7967b9f9', 'volume_name': 'volume-4f745249-8845-4175-acf2-56ec7967b9f9', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524b84dc-06e9-4bfc-ade5-fb731d2258c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524b84dc-06e9-4bfc-ade5-fb731d2258c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32929d0f-8b78-46c8-bb37-f2e663eab64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:45 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Volume 4f745249-8845-4175-acf2-56ec7967b9f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f745249-8845-4175-acf2-56ec7967b9f9', 'volume_size': 1}
Jun 18 11:28:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:28:46 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3851e07-d523-44e0-9ea0-e25005e9fa97" returned: 0 in 0.700s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.530s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-76341023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f745249-8845-4175-acf2-56ec7967b9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fecb044bb23452994aa2d847c1bb086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:28:45Z,use_quota=True,user_id='626d3d3242794d90b41a1b9ad4678297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Creating volume 4f745249-8845-4175-acf2-56ec7967b9f9 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:28:46 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:46 devstack sudo[97269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9 1073741824
Jun 18 11:28:46 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e7407a-2233-4662-8e86-72ddb6301bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3851e07-d523-44e0-9ea0-e25005e9fa97', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3b6f8e-2324-45a1-ae42-8f481165582b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:46 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Volume volume-a3851e07-d523-44e0-9ea0-e25005e9fa97 (a3851e07-d523-44e0-9ea0-e25005e9fa97): created successfully
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3b6f8e-2324-45a1-ae42-8f481165582b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Flow 'volume_create_manager' (a4d85465-2f25-44a0-99f1-2ae0dc041530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:28:46 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-a22ef1ae-0646-47fc-ab87-25d151af6210 tempest-AttachVolumeNegativeTest-1434192735 None] Created volume successfully.
Jun 18 11:28:46 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9 1073741824" returned: 0 in 0.892s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:47 devstack sudo[97282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9
Jun 18 11:28:47 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:47 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9" returned: 0 in 0.677s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32929d0f-8b78-46c8-bb37-f2e663eab64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f745249-8845-4175-acf2-56ec7967b9f9', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99f1ceb-efc4-40cc-a9e1-7fdb866411b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:47 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Volume volume-4f745249-8845-4175-acf2-56ec7967b9f9 (4f745249-8845-4175-acf2-56ec7967b9f9): created successfully
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99f1ceb-efc4-40cc-a9e1-7fdb866411b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Flow 'volume_create_manager' (2f2a9e93-a0f9-445f-888a-c01993f57b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:28:47 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-002be72b-6a32-429b-bc4d-462ee4b87f68 tempest-SnapshotMetadataTestJSON-580019137 None] Created volume successfully.
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Flow 'volume_create_manager' (4d20a552-11b7-42d5-a5d4-00a1f95c82ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32863e84-6cdf-47ca-b143-e7b025621a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32863e84-6cdf-47ca-b143-e7b025621a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-666302724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73f91bd-cebe-4686-bd9b-f3b021edb681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea979d22bc84e1ca18e280dd9e7040e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:28:48Z,use_quota=True,user_id='3ba436f530d244efa4eb14ff97c07e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7aa374-ed12-414f-a504-12f3920a8a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7aa374-ed12-414f-a504-12f3920a8a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b38396-6faf-4767-b8f9-5aa71c154ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b38396-6faf-4767-b8f9-5aa71c154ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73f91bd-cebe-4686-bd9b-f3b021edb681', 'volume_name': 'volume-c73f91bd-cebe-4686-bd9b-f3b021edb681', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ea037f-67ff-41cf-8b82-a17834dda1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ea037f-67ff-41cf-8b82-a17834dda1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6c348f-2933-417d-bf11-ea4f4fb1e206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:47 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Volume c73f91bd-cebe-4686-bd9b-f3b021edb681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73f91bd-cebe-4686-bd9b-f3b021edb681', 'volume_size': 1}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-666302724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73f91bd-cebe-4686-bd9b-f3b021edb681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea979d22bc84e1ca18e280dd9e7040e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:28:48Z,use_quota=True,user_id='3ba436f530d244efa4eb14ff97c07e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Creating volume c73f91bd-cebe-4686-bd9b-f3b021edb681 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:28:47 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:28:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:47 devstack sudo[97285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681 1073741824
Jun 18 11:28:47 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:48 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681 1073741824" returned: 0 in 0.984s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:28:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:48 devstack sudo[97293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681
Jun 18 11:28:48 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-5d3a57c3-c481-4900-8923-81a075ceec78 req-4f3dd071-a9a7-4331-8e87-62323b6e3f17 tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:28:49 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681" returned: 0 in 0.646s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:49 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:28:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:28:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.659s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:28:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6c348f-2933-417d-bf11-ea4f4fb1e206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73f91bd-cebe-4686-bd9b-f3b021edb681', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ea1d36-099f-4fb1-be0c-427d5dea1ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:28:49 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] Creating offline snapshot 3c027c54-fba4-45b9-adbe-c580edaecb47 of volume 4f745249-8845-4175-acf2-56ec7967b9f9 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:28:49 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Volume volume-c73f91bd-cebe-4686-bd9b-f3b021edb681 (c73f91bd-cebe-4686-bd9b-f3b021edb681): created successfully
Jun 18 11:28:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ea1d36-099f-4fb1-be0c-427d5dea1ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:28:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Flow 'volume_create_manager' (4d20a552-11b7-42d5-a5d4-00a1f95c82ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:28:49 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d869c9-9706-467a-be7b-9b3ded738355]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:28:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:49 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-3b43ab09-a8c0-46a1-9faa-b06d2612025e tempest-ServerActionsTestOtherA-676525830 None] Created volume successfully.
Jun 18 11:28:49 devstack sudo[97304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9
Jun 18 11:28:49 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:50 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9" returned: 0 in 0.805s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:50 devstack sudo[97312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47 1G
Jun 18 11:28:50 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:51 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47 1G" returned: 0 in 0.838s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f745249-8845-4175-acf2-56ec7967b9f9 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:51 devstack sudo[97317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f745249-8845-4175-acf2-56ec7967b9f9 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47
Jun 18 11:28:51 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:51 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f745249-8845-4175-acf2-56ec7967b9f9 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47" returned: 0 in 0.694s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:51 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47 is being set with open permissions: ugo+rw
Jun 18 11:28:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:51 devstack sudo[97323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47
Jun 18 11:28:51 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:52 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47" returned: 0 in 0.664s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:52 devstack sudo[97326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.info
Jun 18 11:28:52 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:53 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.info" returned: 0 in 0.678s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:53 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.info is being set with open permissions: ugo+rw
Jun 18 11:28:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:53 devstack sudo[97329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.info
Jun 18 11:28:53 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:53 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.info" returned: 0 in 0.647s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.454s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:28:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-5d3a57c3-c481-4900-8923-81a075ceec78 req-4f3dd071-a9a7-4331-8e87-62323b6e3f17 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.588s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:28:54 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8afbea0-0e26-4aaa-a777-50257c8a36c1]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:28:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-5d3a57c3-c481-4900-8923-81a075ceec78 req-4f3dd071-a9a7-4331-8e87-62323b6e3f17 tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3851e07-d523-44e0-9ea0-e25005e9fa97 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:54 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-9dfafd77-c2f2-4864-bbeb-9602a49ccec9 tempest-SnapshotMetadataTestJSON-580019137 None] Create snapshot completed successfully
Jun 18 11:28:54 devstack sudo[97332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3851e07-d523-44e0-9ea0-e25005e9fa97
Jun 18 11:28:54 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:54 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-5d3a57c3-c481-4900-8923-81a075ceec78 req-4f3dd071-a9a7-4331-8e87-62323b6e3f17 tempest-AttachVolumeNegativeTest-1434192735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3851e07-d523-44e0-9ea0-e25005e9fa97" returned: 0 in 0.747s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-5d3a57c3-c481-4900-8923-81a075ceec78 req-4f3dd071-a9a7-4331-8e87-62323b6e3f17 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.771s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:28:54 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-5d3a57c3-c481-4900-8923-81a075ceec78 req-4f3dd071-a9a7-4331-8e87-62323b6e3f17 tempest-AttachVolumeNegativeTest-1434192735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-a3851e07-d523-44e0-9ea0-e25005e9fa97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af3f3e6c-5ef4-46ef-b98a-bcd482b87f9f', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:28:54 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-5d3a57c3-c481-4900-8923-81a075ceec78 req-4f3dd071-a9a7-4331-8e87-62323b6e3f17 tempest-AttachVolumeNegativeTest-1434192735 None] attachment_update completed successfully.
Jun 18 11:28:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Acquiring lock "cinder-3c027c54-fba4-45b9-adbe-c580edaecb47-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:28:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Lock "cinder-3c027c54-fba4-45b9-adbe-c580edaecb47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:28:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Acquiring lock "cinder-quobyte-4f745249-8845-4175-acf2-56ec7967b9f9" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:28:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Lock "cinder-quobyte-4f745249-8845-4175-acf2-56ec7967b9f9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:28:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Acquiring lock "cinder-quobyte-3c027c54-fba4-45b9-adbe-c580edaecb47" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:28:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Lock "cinder-quobyte-3c027c54-fba4-45b9-adbe-c580edaecb47" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:28:55 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Deleting offline snapshot 3c027c54-fba4-45b9-adbe-c580edaecb47 of volume 4f745249-8845-4175-acf2-56ec7967b9f9 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:28:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] snapshot_file for this snap is: volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:28:56 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d92377-8a54-47a5-9a4a-eb217b143efd]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:28:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:56 devstack sudo[97720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47
Jun 18 11:28:56 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:56 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47" returned: 0 in 0.900s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f745249-8845-4175-acf2-56ec7967b9f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:28:56 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48f590f-f0c9-417a-8142-ba3334a8de83]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:28:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:57 devstack sudo[97725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9
Jun 18 11:28:57 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:57 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9" returned: 0 in 0.942s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:57 devstack sudo[97749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47
Jun 18 11:28:57 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:58 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47" returned: 0 in 0.714s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:28:58 devstack sudo[97761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47
Jun 18 11:28:58 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:28:59 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root
Jun 18 11:28:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9.3c027c54-fba4-45b9-adbe-c580edaecb47" returned: 0 in 0.874s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:28:59 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=35,cinder:UPDATE=35,cinder:DELETE=3,cinder:INSERT=11 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:28:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Lock "cinder-quobyte-3c027c54-fba4-45b9-adbe-c580edaecb47" released by "_delete_snapshot" :: held 3.587s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:28:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Lock "cinder-quobyte-4f745249-8845-4175-acf2-56ec7967b9f9" released by "delete_snapshot" :: held 3.617s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:28:59 devstack cinder-volume[91663]: WARNING cinder.quota [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:28:59 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Created reservations ['323bfccb-b0bc-4c27-84fd-50a6e85ead29', 'cbc7dd10-a384-4fc3-8a3f-1b6629af3c0a', 'd7d06928-c3e6-4061-a64f-b18fdc005d8c', '901cfa3f-395f-43f8-8467-57b358f50da7'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:28:59 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Delete snapshot completed successfully.
Jun 18 11:28:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-eeb901f8-f80f-4bca-8966-f0b87a56174b tempest-SnapshotMetadataTestJSON-580019137 None] Lock "cinder-3c027c54-fba4-45b9-adbe-c580edaecb47-delete_snapshot" released by "delete_snapshot" :: held 3.805s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:29:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] Acquiring lock "cinder-4f745249-8845-4175-acf2-56ec7967b9f9-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:29:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] Lock "cinder-4f745249-8845-4175-acf2-56ec7967b9f9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:29:00 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=47,cinder:UPDATE=42,cinder:INSERT=17,cinder:DELETE=5 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:29:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] Acquiring lock "cinder-quobyte-4f745249-8845-4175-acf2-56ec7967b9f9" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:29:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] Lock "cinder-quobyte-4f745249-8845-4175-acf2-56ec7967b9f9" acquired by "delete_volume" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:29:00 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[72735395-b76b-40ff-85b2-821ac10604ac]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:29:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:29:00 devstack sudo[97801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9
Jun 18 11:29:00 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:29:01 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root
Jun 18 11:29:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9" returned: 0 in 0.964s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:29:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:29:01 devstack sudo[97812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9
Jun 18 11:29:01 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:29:02 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root
Jun 18 11:29:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4f745249-8845-4175-acf2-56ec7967b9f9" returned: 0 in 0.669s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:29:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] Lock "cinder-quobyte-4f745249-8845-4175-acf2-56ec7967b9f9" released by "delete_volume" :: held 1.719s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:29:02 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] Created reservations ['17e5d042-2d79-412b-8ebf-2bde70031e1d', '6fa078b0-da24-40f6-a994-f5b1f4a7a23a', 'fa2359f3-a577-4c3b-ad34-f789cc996c1c', '9aff2347-9fef-42c1-bb94-e7b083dfe400'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:29:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:29:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:29:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:29:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:29:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:29:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:29:02 devstack sudo[97815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:29:02 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:29:03 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root
Jun 18 11:29:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.959s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:29:03 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:29:03 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] Deleted volume successfully.
Jun 18 11:29:03 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-727123d4-5ab9-4015-ab44-d5947a6f779b tempest-SnapshotMetadataTestJSON-580019137 None] Lock "cinder-4f745249-8845-4175-acf2-56ec7967b9f9-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Flow 'volume_create_manager' (4ecb654a-d64f-40cb-a115-85565018c934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647241d8-a420-4514-8873-caf8da7c3702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647241d8-a420-4514-8873-caf8da7c3702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1846593161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a02c814-6588-4174-a4b7-3de200150b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b84011e514543b985367614bcd85671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:29:08Z,use_quota=True,user_id='f2df84478927446a9f3c60dbc7a44db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff968a3-5385-4d14-a3a4-2638ba173f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff968a3-5385-4d14-a3a4-2638ba173f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c663dc-8d68-4424-9ddb-874cf905e1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c663dc-8d68-4424-9ddb-874cf905e1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a02c814-6588-4174-a4b7-3de200150b73', 'volume_name': 'volume-6a02c814-6588-4174-a4b7-3de200150b73', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1221393f-408e-4f3d-a242-a545e81eecd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1221393f-408e-4f3d-a242-a545e81eecd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c436107a-43b2-4f44-90ad-60c355bbd296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:08 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Volume 6a02c814-6588-4174-a4b7-3de200150b73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a02c814-6588-4174-a4b7-3de200150b73', 'volume_size': 1}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1846593161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a02c814-6588-4174-a4b7-3de200150b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b84011e514543b985367614bcd85671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:29:08Z,use_quota=True,user_id='f2df84478927446a9f3c60dbc7a44db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Creating volume 6a02c814-6588-4174-a4b7-3de200150b73 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:29:08 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:29:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6a02c814-6588-4174-a4b7-3de200150b73 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:29:08 devstack sudo[97872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6a02c814-6588-4174-a4b7-3de200150b73 1073741824
Jun 18 11:29:08 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:29:09 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root
Jun 18 11:29:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6a02c814-6588-4174-a4b7-3de200150b73 1073741824" returned: 0 in 1.068s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:29:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6a02c814-6588-4174-a4b7-3de200150b73 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:29:09 devstack sudo[97879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6a02c814-6588-4174-a4b7-3de200150b73
Jun 18 11:29:09 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:29:10 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root
Jun 18 11:29:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6a02c814-6588-4174-a4b7-3de200150b73" returned: 0 in 1.173s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:29:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] <== create_volume: return (2311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:29:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.318s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:29:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c436107a-43b2-4f44-90ad-60c355bbd296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a02c814-6588-4174-a4b7-3de200150b73', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fed12e5-d8fc-4154-b63f-862387dfb546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:10 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Volume volume-6a02c814-6588-4174-a4b7-3de200150b73 (6a02c814-6588-4174-a4b7-3de200150b73): created successfully
Jun 18 11:29:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fed12e5-d8fc-4154-b63f-862387dfb546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Flow 'volume_create_manager' (4ecb654a-d64f-40cb-a115-85565018c934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:29:10 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-87e69aa9-264e-4a44-b772-91880fab81df tempest-AbsoluteLimitsTests-546576913 None] Created volume successfully.
Jun 18 11:29:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] Acquiring lock "cinder-6a02c814-6588-4174-a4b7-3de200150b73-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:29:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] Lock "cinder-6a02c814-6588-4174-a4b7-3de200150b73-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:29:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] Acquiring lock "cinder-quobyte-6a02c814-6588-4174-a4b7-3de200150b73" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:29:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] Lock "cinder-quobyte-6a02c814-6588-4174-a4b7-3de200150b73" acquired by "delete_volume" :: waited 0.026s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:29:12 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b729a3-454f-4884-93fa-2b29857132fe]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:29:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6a02c814-6588-4174-a4b7-3de200150b73 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:29:12 devstack sudo[97886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6a02c814-6588-4174-a4b7-3de200150b73
Jun 18 11:29:12 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:29:13 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root
Jun 18 11:29:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6a02c814-6588-4174-a4b7-3de200150b73" returned: 0 in 1.296s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:29:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6a02c814-6588-4174-a4b7-3de200150b73 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:29:13 devstack sudo[97943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6a02c814-6588-4174-a4b7-3de200150b73
Jun 18 11:29:13 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:29:14 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root
Jun 18 11:29:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6a02c814-6588-4174-a4b7-3de200150b73" returned: 0 in 0.766s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:29:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] Lock "cinder-quobyte-6a02c814-6588-4174-a4b7-3de200150b73" released by "delete_volume" :: held 2.112s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:29:14 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] Created reservations ['f47ddc22-4145-4c57-b364-e569e9db1e58', '63ad7bd8-99e7-466d-8c5f-5863a05df01c', '40e231b7-4615-46f1-821f-4361c9ce5044', 'bdb9191a-850d-4f08-8066-9511d420de6e'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:29:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:29:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:29:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:29:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:29:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:29:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:29:14 devstack sudo[97946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:29:14 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:29:15 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root
Jun 18 11:29:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.695s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:29:15 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:29:15 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] Deleted volume successfully.
Jun 18 11:29:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-286dbac6-1fb2-4d48-bbf2-00f71228fe26 tempest-AbsoluteLimitsTests-546576913 None] Lock "cinder-6a02c814-6588-4174-a4b7-3de200150b73-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:29:24 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=14,cinder:INSERT=6,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:29:25 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=14,cinder:INSERT=6,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:29:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:29:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:29:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:29:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:29:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:29:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:29:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:29:25 devstack sudo[98129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:29:25 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:29:27 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root
Jun 18 11:29:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.623s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:29:27 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:29:27 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:29:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:29:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Flow 'volume_create_manager' (78605a9d-b784-4eb2-9f1c-549766184425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a87a38-2db4-4936-9428-0d08a579735c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a87a38-2db4-4936-9428-0d08a579735c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-282495099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ebd4b6-71c3-4de4-816f-0cc19da3dc6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba93793711144ccb44319cc01ec951d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:29:35Z,use_quota=True,user_id='eded10bebc9f4c028b0dff80944d335a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b350b23f-d432-4466-ac4e-6a90da77bb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b350b23f-d432-4466-ac4e-6a90da77bb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f068db9-349b-4fda-8fdb-443250846cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f068db9-349b-4fda-8fdb-443250846cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34ebd4b6-71c3-4de4-816f-0cc19da3dc6c', 'volume_name': 'volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3a69b8-ab47-4618-8993-8598fe405ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3a69b8-ab47-4618-8993-8598fe405ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbbbbbd-5084-4d1f-ad5a-43a7c53807a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:35 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Volume 34ebd4b6-71c3-4de4-816f-0cc19da3dc6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c', 'volume_size': 1}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-282495099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ebd4b6-71c3-4de4-816f-0cc19da3dc6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba93793711144ccb44319cc01ec951d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:29:35Z,use_quota=True,user_id='eded10bebc9f4c028b0dff80944d335a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Creating volume 34ebd4b6-71c3-4de4-816f-0cc19da3dc6c {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:29:35 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:29:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:29:35 devstack sudo[98167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c 1073741824
Jun 18 11:29:35 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:29:36 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root
Jun 18 11:29:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c 1073741824" returned: 0 in 0.980s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:29:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:29:36 devstack sudo[98174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c
Jun 18 11:29:36 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:29:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-39764248-2b10-4ae7-b2b4-bac0dc1482e9 req-47fa6fdc-d332-4719-8b32-c7378bf3dfe5 tempest-ServerActionsTestOtherA-676525830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:29:36 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root
Jun 18 11:29:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" returned: 0 in 0.652s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:29:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:29:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:29:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-39764248-2b10-4ae7-b2b4-bac0dc1482e9 req-47fa6fdc-d332-4719-8b32-c7378bf3dfe5 tempest-ServerActionsTestOtherA-676525830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.221s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:29:36 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbbbbbd-5084-4d1f-ad5a-43a7c53807a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:36 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0003172-98b8-4891-b776-6db6f9833c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:36 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bcd812-3948-4f68-a90d-fc72cb06ea02]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:29:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-39764248-2b10-4ae7-b2b4-bac0dc1482e9 req-47fa6fdc-d332-4719-8b32-c7378bf3dfe5 tempest-ServerActionsTestOtherA-676525830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:29:37 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Volume volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c (34ebd4b6-71c3-4de4-816f-0cc19da3dc6c): created successfully
Jun 18 11:29:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0003172-98b8-4891-b776-6db6f9833c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Flow 'volume_create_manager' (78605a9d-b784-4eb2-9f1c-549766184425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:29:37 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-ee6588ce-4d65-4e72-adf6-6f4bde2cba7d tempest-VolumesActionsTest-1068918585 None] Created volume successfully.
Jun 18 11:29:37 devstack sudo[98186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681
Jun 18 11:29:37 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:29:37 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root
Jun 18 11:29:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-39764248-2b10-4ae7-b2b4-bac0dc1482e9 req-47fa6fdc-d332-4719-8b32-c7378bf3dfe5 tempest-ServerActionsTestOtherA-676525830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681" returned: 0 in 0.836s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:29:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-39764248-2b10-4ae7-b2b4-bac0dc1482e9 req-47fa6fdc-d332-4719-8b32-c7378bf3dfe5 tempest-ServerActionsTestOtherA-676525830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.868s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:29:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-39764248-2b10-4ae7-b2b4-bac0dc1482e9 req-47fa6fdc-d332-4719-8b32-c7378bf3dfe5 tempest-ServerActionsTestOtherA-676525830 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-c73f91bd-cebe-4686-bd9b-f3b021edb681', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '047f784c-d313-4fe7-ac14-2867522796b6', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:29:37 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-39764248-2b10-4ae7-b2b4-bac0dc1482e9 req-47fa6fdc-d332-4719-8b32-c7378bf3dfe5 tempest-ServerActionsTestOtherA-676525830 None] attachment_update completed successfully.
Jun 18 11:29:46 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-57df52c0-20da-4f2f-9284-fe8cb347ce17 req-d75979cb-b985-44b7-8dc2-b5a6b72f97fe tempest-ServerActionsTestOtherA-676525830 None] Terminate volume connection completed successfully.
Jun 18 11:29:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-57df52c0-20da-4f2f-9284-fe8cb347ce17 req-d75979cb-b985-44b7-8dc2-b5a6b72f97fe tempest-ServerActionsTestOtherA-676525830 None] Deleting attachment 047f784c-d313-4fe7-ac14-2867522796b6. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:29:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-57df52c0-20da-4f2f-9284-fe8cb347ce17 req-693d0fe9-6a93-4863-af82-e85a8fc487ec tempest-ServerActionsTestOtherA-676525830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:29:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-57df52c0-20da-4f2f-9284-fe8cb347ce17 req-693d0fe9-6a93-4863-af82-e85a8fc487ec tempest-ServerActionsTestOtherA-676525830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:29:49 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[0caffc93-5932-4ebe-8126-2b3c905518a5]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:29:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-57df52c0-20da-4f2f-9284-fe8cb347ce17 req-693d0fe9-6a93-4863-af82-e85a8fc487ec tempest-ServerActionsTestOtherA-676525830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:29:49 devstack sudo[98388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681
Jun 18 11:29:49 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:29:50 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root
Jun 18 11:29:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-57df52c0-20da-4f2f-9284-fe8cb347ce17 req-693d0fe9-6a93-4863-af82-e85a8fc487ec tempest-ServerActionsTestOtherA-676525830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681" returned: 0 in 0.865s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:29:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-57df52c0-20da-4f2f-9284-fe8cb347ce17 req-693d0fe9-6a93-4863-af82-e85a8fc487ec tempest-ServerActionsTestOtherA-676525830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.906s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:29:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-57df52c0-20da-4f2f-9284-fe8cb347ce17 req-693d0fe9-6a93-4863-af82-e85a8fc487ec tempest-ServerActionsTestOtherA-676525830 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-c73f91bd-cebe-4686-bd9b-f3b021edb681', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64873365-0de3-41cd-a874-0f3356c96b75', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:29:50 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-57df52c0-20da-4f2f-9284-fe8cb347ce17 req-693d0fe9-6a93-4863-af82-e85a8fc487ec tempest-ServerActionsTestOtherA-676525830 None] attachment_update completed successfully.
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Flow 'volume_create_manager' (b743c556-5cc2-4e56-886b-59faac01140a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c24a9d1-565c-40dc-9aa2-c1ff609ec824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c24a9d1-565c-40dc-9aa2-c1ff609ec824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-768993323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34bb9e51-13ec-4007-af87-897ae0d76db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80a7ad330334b76816aba0c1ef0484e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:29:53Z,use_quota=True,user_id='312ee39232f4474cad92c3090ee16ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c7745d-674b-4f93-be98-e095629a99b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c7745d-674b-4f93-be98-e095629a99b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3422827c-6db1-4870-8a4a-ceb6c995140f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3422827c-6db1-4870-8a4a-ceb6c995140f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34bb9e51-13ec-4007-af87-897ae0d76db2', 'volume_name': 'volume-34bb9e51-13ec-4007-af87-897ae0d76db2', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86693fa-af55-4a09-bdae-18093a225da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86693fa-af55-4a09-bdae-18093a225da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c7e779-cba9-4687-80a2-e147027e2a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:52 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Volume 34bb9e51-13ec-4007-af87-897ae0d76db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34bb9e51-13ec-4007-af87-897ae0d76db2', 'volume_size': 1}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-768993323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34bb9e51-13ec-4007-af87-897ae0d76db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80a7ad330334b76816aba0c1ef0484e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:29:53Z,use_quota=True,user_id='312ee39232f4474cad92c3090ee16ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Creating volume 34bb9e51-13ec-4007-af87-897ae0d76db2 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:29:52 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:29:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34bb9e51-13ec-4007-af87-897ae0d76db2 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:29:52 devstack sudo[98467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34bb9e51-13ec-4007-af87-897ae0d76db2 1073741824
Jun 18 11:29:52 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:29:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-14f5e898-0700-4377-a46f-fe9301543d61 tempest-VolumesActionsTest-1068918585 None] Acquiring lock "cinder-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" by "attach_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:29:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-14f5e898-0700-4377-a46f-fe9301543d61 tempest-VolumesActionsTest-1068918585 None] Lock "cinder-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" acquired by "attach_volume" :: waited 0.036s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:29:54 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-14f5e898-0700-4377-a46f-fe9301543d61 tempest-VolumesActionsTest-1068918585 None] Attaching volume 34ebd4b6-71c3-4de4-816f-0cc19da3dc6c to instance c8e57abe-a88a-49c6-82dd-9377f3c7f156 at mountpoint /dev/vdb on host None.
Jun 18 11:29:54 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-14f5e898-0700-4377-a46f-fe9301543d61 tempest-VolumesActionsTest-1068918585 None] Attach volume completed successfully.
Jun 18 11:29:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-14f5e898-0700-4377-a46f-fe9301543d61 tempest-VolumesActionsTest-1068918585 None] Lock "cinder-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" released by "attach_volume" :: held 0.162s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:29:54 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root
Jun 18 11:29:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34bb9e51-13ec-4007-af87-897ae0d76db2 1073741824" returned: 0 in 1.508s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:29:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34bb9e51-13ec-4007-af87-897ae0d76db2 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:29:54 devstack sudo[98484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34bb9e51-13ec-4007-af87-897ae0d76db2
Jun 18 11:29:54 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:29:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-439441ef-3478-4207-b2cb-89a806dc6cb0 tempest-VolumesActionsTest-1068918585 None] Acquiring lock "cinder-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c-detach_volume" by "detach_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:29:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-439441ef-3478-4207-b2cb-89a806dc6cb0 tempest-VolumesActionsTest-1068918585 None] Lock "cinder-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:29:54 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-439441ef-3478-4207-b2cb-89a806dc6cb0 tempest-VolumesActionsTest-1068918585 None] Detaching volume 34ebd4b6-71c3-4de4-816f-0cc19da3dc6c from instance c8e57abe-a88a-49c6-82dd-9377f3c7f156.
Jun 18 11:29:54 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-439441ef-3478-4207-b2cb-89a806dc6cb0 tempest-VolumesActionsTest-1068918585 None] Detach volume completed successfully.
Jun 18 11:29:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-439441ef-3478-4207-b2cb-89a806dc6cb0 tempest-VolumesActionsTest-1068918585 None] Lock "cinder-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:29:55 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root
Jun 18 11:29:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34bb9e51-13ec-4007-af87-897ae0d76db2" returned: 0 in 0.805s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:29:55 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] <== create_volume: return (2382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:29:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.385s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:29:55 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c7e779-cba9-4687-80a2-e147027e2a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34bb9e51-13ec-4007-af87-897ae0d76db2', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:55 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91a5d89-f4d0-4a81-960a-93aabc5c5e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:29:55 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Volume volume-34bb9e51-13ec-4007-af87-897ae0d76db2 (34bb9e51-13ec-4007-af87-897ae0d76db2): created successfully
Jun 18 11:29:55 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91a5d89-f4d0-4a81-960a-93aabc5c5e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:29:55 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Flow 'volume_create_manager' (b743c556-5cc2-4e56-886b-59faac01140a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:29:55 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-9971a88b-f806-40f3-b141-41e09b9869e9 tempest-AttachVolumeTestJSON-85158170 None] Created volume successfully.
Jun 18 11:29:56 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-27294e96-0545-487b-b2c1-c5105cfe6c8d req-71704823-fd75-4948-9bba-06903476b845 tempest-AttachVolumeNegativeTest-1434192735 None] Terminate volume connection completed successfully.
Jun 18 11:29:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-27294e96-0545-487b-b2c1-c5105cfe6c8d req-71704823-fd75-4948-9bba-06903476b845 tempest-AttachVolumeNegativeTest-1434192735 None] Deleting attachment af3f3e6c-5ef4-46ef-b98a-bcd482b87f9f. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:29:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-ab797b92-21da-45d2-9174-b3881c9c787a req-1923f1e9-d251-4334-b22f-c8819c171788 tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:29:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-ab797b92-21da-45d2-9174-b3881c9c787a req-1923f1e9-d251-4334-b22f-c8819c171788 tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:29:59 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36f8ace-e7fe-4467-9b63-72eea532461a]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:29:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-ab797b92-21da-45d2-9174-b3881c9c787a req-1923f1e9-d251-4334-b22f-c8819c171788 tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34bb9e51-13ec-4007-af87-897ae0d76db2 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:29:59 devstack sudo[98623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34bb9e51-13ec-4007-af87-897ae0d76db2
Jun 18 11:29:59 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:00 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-ab797b92-21da-45d2-9174-b3881c9c787a req-1923f1e9-d251-4334-b22f-c8819c171788 tempest-AttachVolumeTestJSON-85158170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34bb9e51-13ec-4007-af87-897ae0d76db2" returned: 0 in 1.393s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-ab797b92-21da-45d2-9174-b3881c9c787a req-1923f1e9-d251-4334-b22f-c8819c171788 tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.439s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:30:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-ab797b92-21da-45d2-9174-b3881c9c787a req-1923f1e9-d251-4334-b22f-c8819c171788 tempest-AttachVolumeTestJSON-85158170 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-34bb9e51-13ec-4007-af87-897ae0d76db2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e5ecb0a-70af-49fe-a308-6453bd3d7e40', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:30:00 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-ab797b92-21da-45d2-9174-b3881c9c787a req-1923f1e9-d251-4334-b22f-c8819c171788 tempest-AttachVolumeTestJSON-85158170 None] attachment_update completed successfully.
Jun 18 11:30:05 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Flow 'volume_create_manager' (0e30023a-2208-4893-af8c-446e91a36078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e26595-9b07-49b2-90d3-29a72bdac312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e26595-9b07-49b2-90d3-29a72bdac312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-719815845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80a7ad330334b76816aba0c1ef0484e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:30:06Z,use_quota=True,user_id='312ee39232f4474cad92c3090ee16ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45002c4-6270-426a-bc7d-3da53dba639d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45002c4-6270-426a-bc7d-3da53dba639d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a5a68e-b042-4871-b308-f07d51f34c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a5a68e-b042-4871-b308-f07d51f34c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77', 'volume_name': 'volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9c99c1-78a8-4e50-bc21-3dd7d46cf4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9c99c1-78a8-4e50-bc21-3dd7d46cf4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d499f1-55bb-47c7-8aa9-0cd6bf923a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:30:06 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Volume ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77', 'volume_size': 1}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-719815845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80a7ad330334b76816aba0c1ef0484e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:30:06Z,use_quota=True,user_id='312ee39232f4474cad92c3090ee16ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Creating volume ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:30:06 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:30:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:06 devstack sudo[98655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77 1073741824
Jun 18 11:30:06 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:07 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77 1073741824" returned: 0 in 1.144s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:07 devstack sudo[98661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77
Jun 18 11:30:07 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:08 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77" returned: 0 in 0.804s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:30:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:30:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d499f1-55bb-47c7-8aa9-0cd6bf923a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:30:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af3a257-0fcf-4b6a-8796-022d1ae32c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:30:08 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Volume volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77 (ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77): created successfully
Jun 18 11:30:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af3a257-0fcf-4b6a-8796-022d1ae32c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:30:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Flow 'volume_create_manager' (0e30023a-2208-4893-af8c-446e91a36078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:30:08 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d83e0c2e-9b11-46f8-94dd-20a1dd212512 tempest-AttachVolumeTestJSON-85158170 None] Created volume successfully.
Jun 18 11:30:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-c36d7e13-5566-49a8-8f9b-57a8ea66bffc req-fd8b49ae-0e33-431b-aec8-7c28a94728d9 tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:30:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-c36d7e13-5566-49a8-8f9b-57a8ea66bffc req-fd8b49ae-0e33-431b-aec8-7c28a94728d9 tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:30:12 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cf8535-04dc-4e31-a3af-f121fed47bb9]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:30:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-c36d7e13-5566-49a8-8f9b-57a8ea66bffc req-fd8b49ae-0e33-431b-aec8-7c28a94728d9 tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:12 devstack sudo[98718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77
Jun 18 11:30:12 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:13 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-c36d7e13-5566-49a8-8f9b-57a8ea66bffc req-fd8b49ae-0e33-431b-aec8-7c28a94728d9 tempest-AttachVolumeTestJSON-85158170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77" returned: 0 in 0.765s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-c36d7e13-5566-49a8-8f9b-57a8ea66bffc req-fd8b49ae-0e33-431b-aec8-7c28a94728d9 tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.781s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:30:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-c36d7e13-5566-49a8-8f9b-57a8ea66bffc req-fd8b49ae-0e33-431b-aec8-7c28a94728d9 tempest-AttachVolumeTestJSON-85158170 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5a3f45b-d693-4a7c-9ae7-ada3e6935f89', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:30:13 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-c36d7e13-5566-49a8-8f9b-57a8ea66bffc req-fd8b49ae-0e33-431b-aec8-7c28a94728d9 tempest-AttachVolumeTestJSON-85158170 None] attachment_update completed successfully.
Jun 18 11:30:20 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-54dcd660-f6dc-48da-823a-cf56570e855f req-929d5a02-9c3e-4f46-bce7-28764118dbbe tempest-AttachVolumeTestJSON-85158170 None] Terminate volume connection completed successfully.
Jun 18 11:30:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-54dcd660-f6dc-48da-823a-cf56570e855f req-929d5a02-9c3e-4f46-bce7-28764118dbbe tempest-AttachVolumeTestJSON-85158170 None] Deleting attachment 2e5ecb0a-70af-49fe-a308-6453bd3d7e40. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:30:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a9d9af3f-cf8c-417e-8a29-c47e56a665ea tempest-VolumesActionsTest-1068918585 None] Acquiring lock "cinder-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" by "attach_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:30:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a9d9af3f-cf8c-417e-8a29-c47e56a665ea tempest-VolumesActionsTest-1068918585 None] Lock "cinder-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" acquired by "attach_volume" :: waited 0.030s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:30:21 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-a9d9af3f-cf8c-417e-8a29-c47e56a665ea tempest-VolumesActionsTest-1068918585 None] Attaching volume 34ebd4b6-71c3-4de4-816f-0cc19da3dc6c to instance 8e4a79d2-a21f-4815-9798-b58d28f0de3c at mountpoint /dev/vdb on host None.
Jun 18 11:30:21 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-a9d9af3f-cf8c-417e-8a29-c47e56a665ea tempest-VolumesActionsTest-1068918585 None] Attach volume completed successfully.
Jun 18 11:30:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a9d9af3f-cf8c-417e-8a29-c47e56a665ea tempest-VolumesActionsTest-1068918585 None] Lock "cinder-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" released by "attach_volume" :: held 0.107s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:30:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4cb468a2-8322-4277-a152-a30fbd96d8a1 tempest-VolumesActionsTest-1068918585 None] Acquiring lock "cinder-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c-detach_volume" by "detach_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:30:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4cb468a2-8322-4277-a152-a30fbd96d8a1 tempest-VolumesActionsTest-1068918585 None] Lock "cinder-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:30:21 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-4cb468a2-8322-4277-a152-a30fbd96d8a1 tempest-VolumesActionsTest-1068918585 None] Detaching volume 34ebd4b6-71c3-4de4-816f-0cc19da3dc6c from instance 8e4a79d2-a21f-4815-9798-b58d28f0de3c.
Jun 18 11:30:21 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-4cb468a2-8322-4277-a152-a30fbd96d8a1 tempest-VolumesActionsTest-1068918585 None] Detach volume completed successfully.
Jun 18 11:30:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4cb468a2-8322-4277-a152-a30fbd96d8a1 tempest-VolumesActionsTest-1068918585 None] Lock "cinder-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:30:23 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-eee3fb79-8869-4d9e-bee5-1506b4bc5ec6 req-336c8091-63a3-4532-bd45-06be582b6f7c tempest-ServerActionsTestOtherA-676525830 None] Terminate volume connection completed successfully.
Jun 18 11:30:23 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-eee3fb79-8869-4d9e-bee5-1506b4bc5ec6 req-336c8091-63a3-4532-bd45-06be582b6f7c tempest-ServerActionsTestOtherA-676525830 None] Deleting attachment 64873365-0de3-41cd-a874-0f3356c96b75. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:30:23 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-cd086b46-37bf-46ec-b323-89d5236bc5ae req-173a6321-de4e-41ce-aba5-b2f954b04f12 tempest-AttachVolumeTestJSON-85158170 None] Terminate volume connection completed successfully.
Jun 18 11:30:23 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-cd086b46-37bf-46ec-b323-89d5236bc5ae req-173a6321-de4e-41ce-aba5-b2f954b04f12 tempest-AttachVolumeTestJSON-85158170 None] Deleting attachment a5a3f45b-d693-4a7c-9ae7-ada3e6935f89. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:30:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:30:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:30:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:30:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:30:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:30:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:30:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:25 devstack sudo[99004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:30:25 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:26 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.054s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:30:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:30:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:30:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:30:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d35a1c23-6714-4e8b-be07-6047b41d8732 tempest-VolumesActionsTest-1068918585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:30:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d35a1c23-6714-4e8b-be07-6047b41d8732 tempest-VolumesActionsTest-1068918585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:30:32 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4b6b41-ad9f-48f6-962f-102444a78054]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:30:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d35a1c23-6714-4e8b-be07-6047b41d8732 tempest-VolumesActionsTest-1068918585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:32 devstack sudo[99083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c
Jun 18 11:30:32 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:32 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d35a1c23-6714-4e8b-be07-6047b41d8732 tempest-VolumesActionsTest-1068918585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" returned: 0 in 0.820s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:32 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[063b7f8b-4acd-4065-8ea8-20a8adb6c9fa]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:30:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d35a1c23-6714-4e8b-be07-6047b41d8732 tempest-VolumesActionsTest-1068918585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:33 devstack sudo[99088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c
Jun 18 11:30:33 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:33 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=45,cinder:UPDATE=24,cinder:INSERT=3,cinder:DELETE=1 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:30:33 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d35a1c23-6714-4e8b-be07-6047b41d8732 tempest-VolumesActionsTest-1068918585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" returned: 0 in 0.908s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d35a1c23-6714-4e8b-be07-6047b41d8732 tempest-VolumesActionsTest-1068918585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.6622ebe5-cbf7-4c7e-8702-f13a2280a5bf2v0ctc5b.img {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:33 devstack sudo[99094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.6622ebe5-cbf7-4c7e-8702-f13a2280a5bf2v0ctc5b.img
Jun 18 11:30:33 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] Acquiring lock "cinder-c73f91bd-cebe-4686-bd9b-f3b021edb681-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:30:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] Lock "cinder-c73f91bd-cebe-4686-bd9b-f3b021edb681-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:30:37 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=49,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=2 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:30:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] Acquiring lock "cinder-quobyte-c73f91bd-cebe-4686-bd9b-f3b021edb681" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:30:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] Lock "cinder-quobyte-c73f91bd-cebe-4686-bd9b-f3b021edb681" acquired by "delete_volume" :: waited 0.044s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:30:37 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[33adb70a-dd34-4d59-acdd-668d8b27c614]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:30:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:38 devstack sudo[99135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681
Jun 18 11:30:38 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "cinder-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:30:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] Lock "cinder-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:30:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "cinder-quobyte-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:30:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] Lock "cinder-quobyte-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77" acquired by "delete_volume" :: waited 0.029s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:30:38 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cee4e3-21f9-4477-93c4-47772cfc73d5]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:30:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:38 devstack sudo[99137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77
Jun 18 11:30:38 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:39 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681" returned: 0 in 1.653s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:39 devstack sudo[99144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681
Jun 18 11:30:39 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:40 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77" returned: 0 in 1.646s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:40 devstack sudo[99150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77
Jun 18 11:30:40 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:40 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d35a1c23-6714-4e8b-be07-6047b41d8732 tempest-VolumesActionsTest-1068918585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.6622ebe5-cbf7-4c7e-8702-f13a2280a5bf2v0ctc5b.img" returned: 0 in 6.873s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:40 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef69c28-4566-439e-8365-326a34d43d61]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:30:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d35a1c23-6714-4e8b-be07-6047b41d8732 tempest-VolumesActionsTest-1068918585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:40 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c73f91bd-cebe-4686-bd9b-f3b021edb681" returned: 0 in 1.249s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:40 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] Lock "cinder-quobyte-c73f91bd-cebe-4686-bd9b-f3b021edb681" released by "delete_volume" :: held 3.012s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:30:40 devstack sudo[99153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c
Jun 18 11:30:40 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:40 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] Created reservations ['08b07cc2-8332-496b-8c4d-7cf35aca51d8', 'b9ea8f13-629a-40f0-9c06-caa0df3409b1', 'dfb1bb27-2dc8-40ba-b11a-a7e2bfc77013', '78187d80-d9fc-4981-a8fd-4dd0e8229d1d'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:30:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:30:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:30:40 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:41 devstack sudo[99155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:30:41 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:41 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77" returned: 0 in 0.833s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] Lock "cinder-quobyte-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77" released by "delete_volume" :: held 2.577s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] Created reservations ['b2e8b96a-4695-4f5a-9ed1-827eec9e2ca8', '49acbe50-91e4-481e-810a-4cf57e8f3755', 'f02030c0-3dd4-4c4f-abab-5fd5ac21afab', 'e09ae4c6-6050-44d7-9eed-708c632bf756'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:41 devstack sudo[99159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:30:41 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:41 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.850s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:30:41 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] Deleted volume successfully.
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-56999c85-1252-418c-a274-3dcc5534352f tempest-ServerActionsTestOtherA-676525830 None] Lock "cinder-c73f91bd-cebe-4686-bd9b-f3b021edb681-delete_volume" released by "delete_volume" :: held 4.194s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:30:41 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d35a1c23-6714-4e8b-be07-6047b41d8732 tempest-VolumesActionsTest-1068918585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" returned: 0 in 1.173s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-d35a1c23-6714-4e8b-be07-6047b41d8732 tempest-VolumesActionsTest-1068918585 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c, size 1024.00 MB, duration 6.87 sec, destination /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.6622ebe5-cbf7-4c7e-8702-f13a2280a5bf2v0ctc5b.img {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:30:41 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-d35a1c23-6714-4e8b-be07-6047b41d8732 tempest-VolumesActionsTest-1068918585 None] Converted 1024.00 MB image at 148.96 MB/s
Jun 18 11:30:41 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-d35a1c23-6714-4e8b-be07-6047b41d8732 tempest-VolumesActionsTest-1068918585 None] 6622ebe5-cbf7-4c7e-8702-f13a2280a5bf was raw, no need to convert to raw {{(pid=91663) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jun 18 11:30:42 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "cinder-34bb9e51-13ec-4007-af87-897ae0d76db2-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:30:42 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] Lock "cinder-34bb9e51-13ec-4007-af87-897ae0d76db2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:30:42 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.899s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:42 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:30:42 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] Deleted volume successfully.
Jun 18 11:30:42 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "cinder-quobyte-34bb9e51-13ec-4007-af87-897ae0d76db2" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:30:42 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] Lock "cinder-quobyte-34bb9e51-13ec-4007-af87-897ae0d76db2" acquired by "delete_volume" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:30:42 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8670185e-ef13-45f8-bfc9-2d80c2b8fc31 tempest-AttachVolumeTestJSON-85158170 None] Lock "cinder-ae5b3a1c-05c3-44ac-b59c-9af80ae6bb77-delete_volume" released by "delete_volume" :: held 3.787s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:30:42 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48246a1-67cd-4203-90ed-09a380adb4c0]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:30:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34bb9e51-13ec-4007-af87-897ae0d76db2 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:42 devstack sudo[99179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34bb9e51-13ec-4007-af87-897ae0d76db2
Jun 18 11:30:42 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:43 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34bb9e51-13ec-4007-af87-897ae0d76db2" returned: 0 in 1.160s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34bb9e51-13ec-4007-af87-897ae0d76db2 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:43 devstack sudo[99222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34bb9e51-13ec-4007-af87-897ae0d76db2
Jun 18 11:30:43 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:44 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34bb9e51-13ec-4007-af87-897ae0d76db2" returned: 0 in 0.901s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:44 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] Lock "cinder-quobyte-34bb9e51-13ec-4007-af87-897ae0d76db2" released by "delete_volume" :: held 2.112s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:30:44 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] Created reservations ['a1fbeddb-2650-4a51-a7d2-69f6d41cea9b', '37785695-7fb0-44d4-b1c1-bcf28334953a', 'e79b7dfb-3d19-4e58-81a8-c5362ea45af3', '7b15f9fd-c50b-425c-90a2-fff060959fd5'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:30:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:30:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:30:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:30:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:30:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:30:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:44 devstack sudo[99226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:30:44 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:45 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.068s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:45 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:30:45 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] Deleted volume successfully.
Jun 18 11:30:45 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7c5c6da4-906a-4174-b004-4a90eeb3932f tempest-AttachVolumeTestJSON-85158170 None] Lock "cinder-34bb9e51-13ec-4007-af87-897ae0d76db2-delete_volume" released by "delete_volume" :: held 3.573s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:30:45 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "cinder-b78852d8-5a1d-4da1-b39e-fc035a6219d1-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:30:45 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] Lock "cinder-b78852d8-5a1d-4da1-b39e-fc035a6219d1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:30:45 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "cinder-quobyte-b78852d8-5a1d-4da1-b39e-fc035a6219d1" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:30:45 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] Lock "cinder-quobyte-b78852d8-5a1d-4da1-b39e-fc035a6219d1" acquired by "delete_volume" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:30:45 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0756ee-ed01-4a51-ad47-d108ba435a2d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:30:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:46 devstack sudo[99231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1
Jun 18 11:30:46 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:46 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1" returned: 0 in 0.849s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:46 devstack sudo[99236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1
Jun 18 11:30:46 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:47 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b78852d8-5a1d-4da1-b39e-fc035a6219d1" returned: 0 in 0.713s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] Lock "cinder-quobyte-b78852d8-5a1d-4da1-b39e-fc035a6219d1" released by "delete_volume" :: held 1.636s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:30:47 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] Created reservations ['69cf9447-035d-4af7-bfad-760c3eaed454', '1dd526e3-0e65-43fa-9096-95e5c8fd5580', '3086892d-d82e-483a-a13e-e2ae4b05b705', 'b226ddd8-1a51-4791-a054-395d7050b430'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:30:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:30:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:30:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:30:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:30:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:30:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:30:47 devstack sudo[99239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:30:47 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:30:48 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root
Jun 18 11:30:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.846s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:30:48 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:30:48 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] Deleted volume successfully.
Jun 18 11:30:48 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-33432af5-b051-4b21-b312-4420d5c5d0ba tempest-AttachVolumeTestJSON-85158170 None] Lock "cinder-b78852d8-5a1d-4da1-b39e-fc035a6219d1-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:30:52 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:30:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Flow 'volume_create_manager' (7977404f-b358-4048-be58-4d96e19c9117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:30:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8de3a2-376b-45f0-ba24-7ab0666173b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:30:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8de3a2-376b-45f0-ba24-7ab0666173b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-804723830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39be54d-93b1-42e1-bd1f-97770cc7d39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb6fa69b6433ca38923d4961f63a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:30:52Z,use_quota=True,user_id='52ccb25475e344ef9b3ceedc0909c1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:30:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad34188-ad70-47e2-88ca-56a86189ce96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:30:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad34188-ad70-47e2-88ca-56a86189ce96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:30:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238c52fb-a7bb-47df-8ea8-8b351d8fbc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:30:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238c52fb-a7bb-47df-8ea8-8b351d8fbc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b39be54d-93b1-42e1-bd1f-97770cc7d39b', 'volume_name': 'volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:30:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07871ec9-e67b-4f4a-a09d-e3bd751b198b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:30:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07871ec9-e67b-4f4a-a09d-e3bd751b198b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:30:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0829ea61-2216-43d7-a88b-f2bb4a0f2867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:30:52 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Volume b39be54d-93b1-42e1-bd1f-97770cc7d39b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b', 'volume_size': 1}
Jun 18 11:30:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:30:57 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:30:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Flow 'volume_create_manager' (7516b48d-1d80-4a98-b1bb-b6058899ebaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:30:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ccdf7f7-3b25-4b27-8c4a-8dbfec23cc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:30:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ccdf7f7-3b25-4b27-8c4a-8dbfec23cc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-922472809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c05404-f7b5-47ef-a4e9-480ee4763311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1f462f7338425cb6d584136f5edf5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:30:57Z,use_quota=True,user_id='3a56ba600e1940a5888590c105209cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:30:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1bcd61c-ff7c-448a-8fae-d66c134f9e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:30:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1bcd61c-ff7c-448a-8fae-d66c134f9e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:30:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e6c423-13db-4c5c-9611-a92bc3450189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:30:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e6c423-13db-4c5c-9611-a92bc3450189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5c05404-f7b5-47ef-a4e9-480ee4763311', 'volume_name': 'volume-d5c05404-f7b5-47ef-a4e9-480ee4763311', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:30:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b56af08-df14-4abd-9113-fd1d4f675cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:30:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b56af08-df14-4abd-9113-fd1d4f675cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:30:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63eec4e6-3727-42e9-be3d-9991b5681957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:30:57 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Volume d5c05404-f7b5-47ef-a4e9-480ee4763311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5c05404-f7b5-47ef-a4e9-480ee4763311', 'volume_size': 1}
Jun 18 11:30:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:31:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d35a1c23-6714-4e8b-be07-6047b41d8732 tempest-VolumesActionsTest-1068918585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.607s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d35a1c23-6714-4e8b-be07-6047b41d8732 tempest-VolumesActionsTest-1068918585 None] Uploaded volume to glance image-id: 6622ebe5-cbf7-4c7e-8702-f13a2280a5bf. {{(pid=91663) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 18 11:31:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.183s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-804723830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39be54d-93b1-42e1-bd1f-97770cc7d39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb6fa69b6433ca38923d4961f63a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:30:52Z,use_quota=True,user_id='52ccb25475e344ef9b3ceedc0909c1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:31:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Creating volume b39be54d-93b1-42e1-bd1f-97770cc7d39b {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:31:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:31:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:31:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:31:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:31:05 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:31:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:05 devstack sudo[99261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b 1073741824
Jun 18 11:31:05 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:05 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d35a1c23-6714-4e8b-be07-6047b41d8732 tempest-VolumesActionsTest-1068918585 None] Copy volume to image completed successfully.
Jun 18 11:31:06 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b 1073741824" returned: 0 in 1.068s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:06 devstack sudo[99268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b
Jun 18 11:31:06 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:31:07 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b" returned: 0 in 0.786s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.129s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-922472809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c05404-f7b5-47ef-a4e9-480ee4763311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1f462f7338425cb6d584136f5edf5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:30:57Z,use_quota=True,user_id='3a56ba600e1940a5888590c105209cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Creating volume d5c05404-f7b5-47ef-a4e9-480ee4763311 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:31:07 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0829ea61-2216-43d7-a88b-f2bb4a0f2867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:07 devstack sudo[99272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311 1073741824
Jun 18 11:31:07 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebcd6487-9f65-4754-a557-d56f424a0056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:07 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Volume volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b (b39be54d-93b1-42e1-bd1f-97770cc7d39b): created successfully
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebcd6487-9f65-4754-a557-d56f424a0056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Flow 'volume_create_manager' (7977404f-b358-4048-be58-4d96e19c9117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:31:07 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-c27738bb-1332-4308-a517-29c86b4622e0 tempest-AttachVolumeNegativeTest-1434192735 None] Created volume successfully.
Jun 18 11:31:08 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311 1073741824" returned: 0 in 0.945s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:08 devstack sudo[99278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311
Jun 18 11:31:08 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:09 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311" returned: 0 in 0.710s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:31:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.888s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63eec4e6-3727-42e9-be3d-9991b5681957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5c05404-f7b5-47ef-a4e9-480ee4763311', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2838eb-f29d-4e67-b12e-63bc79ad1cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:09 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[8639f530-f5ae-48d4-b56a-75a054210c16]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:09 devstack sudo[99286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c
Jun 18 11:31:09 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:09 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Volume volume-d5c05404-f7b5-47ef-a4e9-480ee4763311 (d5c05404-f7b5-47ef-a4e9-480ee4763311): created successfully
Jun 18 11:31:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2838eb-f29d-4e67-b12e-63bc79ad1cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Flow 'volume_create_manager' (7516b48d-1d80-4a98-b1bb-b6058899ebaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:31:09 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-fbbc1836-c960-4018-a1d6-e614d1092284 req-033a0993-1b4a-4de7-ad89-73c30cf22d3c tempest-VolumesSnapshotsTestJSON-1130832246 None] Created volume successfully.
Jun 18 11:31:10 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" returned: 0 in 0.833s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:10 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f593f9-2bfb-497d-a1ed-a225682d71f0]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:10 devstack sudo[99291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c
Jun 18 11:31:10 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:31:11 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" returned: 0 in 0.896s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.ef8b6917-c2ee-4a09-a556-7234b01ee4dfiiq0xbzc.img {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:11 devstack sudo[99297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.ef8b6917-c2ee-4a09-a556-7234b01ee4dfiiq0xbzc.img
Jun 18 11:31:11 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-3003ca68-9a48-4352-b017-c714e4213c46 req-22faabe3-027e-4e71-9b09-307974b5c4e8 tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:31:16 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.ef8b6917-c2ee-4a09-a556-7234b01ee4dfiiq0xbzc.img" returned: 0 in 5.417s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:16 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[299739aa-234b-4322-9c4e-38e2822c98d6]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:16 devstack sudo[99354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c
Jun 18 11:31:16 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:17 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" returned: 0 in 0.943s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:17 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.ef8b6917-c2ee-4a09-a556-7234b01ee4dfiiq0xbzc.img {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:31:17 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] Converted 1024.00 MB image at 189.00 MB/s
Jun 18 11:31:17 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] ef8b6917-c2ee-4a09-a556-7234b01ee4df was raw, converting to qcow2 {{(pid=91663) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jun 18 11:31:17 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4b39f1-6559-4444-be1f-0beb63c886b6]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.ef8b6917-c2ee-4a09-a556-7234b01ee4dfiiq0xbzc.img {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:17 devstack sudo[99362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.ef8b6917-c2ee-4a09-a556-7234b01ee4dfiiq0xbzc.img
Jun 18 11:31:17 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:18 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.ef8b6917-c2ee-4a09-a556-7234b01ee4dfiiq0xbzc.img" returned: 0 in 0.756s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.ef8b6917-c2ee-4a09-a556-7234b01ee4dfiiq0xbzc.img {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:18 devstack sudo[99367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.ef8b6917-c2ee-4a09-a556-7234b01ee4dfiiq0xbzc.img
Jun 18 11:31:18 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:19 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.ef8b6917-c2ee-4a09-a556-7234b01ee4dfiiq0xbzc.img" returned: 1 in 0.746s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.ef8b6917-c2ee-4a09-a556-7234b01ee4dfiiq0xbzc.img' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:31:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.ef8b6917-c2ee-4a09-a556-7234b01ee4dfiiq0xbzc.img /opt/stack/data/cinder/conversion/vol_upload_13x9srie {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:19 devstack sudo[99372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.ef8b6917-c2ee-4a09-a556-7234b01ee4dfiiq0xbzc.img /opt/stack/data/cinder/conversion/vol_upload_13x9srie
Jun 18 11:31:19 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:19 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.ef8b6917-c2ee-4a09-a556-7234b01ee4dfiiq0xbzc.img /opt/stack/data/cinder/conversion/vol_upload_13x9srie" returned: 0 in 0.648s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:19 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] Image conversion details: src /opt/stack/data/cinder/conversion/34ebd4b6-71c3-4de4-816f-0cc19da3dc6c.temp_image.ef8b6917-c2ee-4a09-a556-7234b01ee4dfiiq0xbzc.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_13x9srie {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:31:19 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] Converted 1024.00 MB image at 1024.00 MB/s
Jun 18 11:31:19 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d357ee-31c1-4137-9cac-634fb6a7d3ec]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_13x9srie {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:19 devstack sudo[99379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_13x9srie
Jun 18 11:31:19 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:20 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_13x9srie" returned: 0 in 0.719s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.412s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] Uploaded volume to glance image-id: ef8b6917-c2ee-4a09-a556-7234b01ee4df. {{(pid=91663) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 18 11:31:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.921s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] Creating offline snapshot 19b881ae-d66a-4d8f-adcc-c829c2204a1a of volume d5c05404-f7b5-47ef-a4e9-480ee4763311 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:31:21 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-9fc1d5ab-5e6d-4e96-8d29-34fcb4241f1b tempest-VolumesActionsTest-1068918585 None] Copy volume to image completed successfully.
Jun 18 11:31:21 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[e592b238-281a-4f66-94ae-d3a979a859f5]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:21 devstack sudo[99384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311
Jun 18 11:31:21 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:22 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311" returned: 0 in 0.881s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:22 devstack sudo[99389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a 1G
Jun 18 11:31:22 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] Acquiring lock "cinder-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:31:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] Lock "cinder-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:31:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] Acquiring lock "cinder-quobyte-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:31:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] Lock "cinder-quobyte-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" acquired by "delete_volume" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:31:23 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[35867aff-e59d-4466-92a0-010476940c5f]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:23 devstack sudo[99391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c
Jun 18 11:31:23 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:23 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a 1G" returned: 0 in 1.162s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5c05404-f7b5-47ef-a4e9-480ee4763311 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:23 devstack sudo[99407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5c05404-f7b5-47ef-a4e9-480ee4763311 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a
Jun 18 11:31:23 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:24 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" returned: 0 in 0.935s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:24 devstack sudo[99415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c
Jun 18 11:31:24 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:24 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5c05404-f7b5-47ef-a4e9-480ee4763311 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a" returned: 0 in 0.807s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:24 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a is being set with open permissions: ugo+rw
Jun 18 11:31:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:24 devstack sudo[99424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a
Jun 18 11:31:24 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:24 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" returned: 0 in 0.751s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] Lock "cinder-quobyte-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c" released by "delete_volume" :: held 1.751s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:31:24 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] Created reservations ['8eb487f7-73d7-46b9-98ab-620bde839c5a', 'c300830f-e660-4e51-b739-aa168d2a0085', '2bdc3228-59a2-4bdc-bf21-e3d0e39c315c', 'abf691cb-6811-4f10-8677-0b2c401573b7'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:31:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:31:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:24 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:31:24 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:31:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:25 devstack sudo[99426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:31:25 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:25 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a" returned: 0 in 0.674s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:31:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:31:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:31:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:31:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:25 devstack sudo[99429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:31:25 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:25 devstack sudo[99431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.info
Jun 18 11:31:25 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:25 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.690s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:25 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:31:25 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] Deleted volume successfully.
Jun 18 11:31:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-191332fd-2513-4616-af1d-b1fcc8784672 tempest-VolumesActionsTest-1068918585 None] Lock "cinder-34ebd4b6-71c3-4de4-816f-0cc19da3dc6c-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:31:26 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.894s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:31:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:31:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:31:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:31:26 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.info" returned: 0 in 0.909s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:26 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.info is being set with open permissions: ugo+rw
Jun 18 11:31:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:26 devstack sudo[99436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.info
Jun 18 11:31:26 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:27 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.info" returned: 0 in 0.833s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.416s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-3003ca68-9a48-4352-b017-c714e4213c46 req-22faabe3-027e-4e71-9b09-307974b5c4e8 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.411s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:27 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4b8122-3bca-4b5a-bdc9-0fb1dbaa8593]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-3003ca68-9a48-4352-b017-c714e4213c46 req-22faabe3-027e-4e71-9b09-307974b5c4e8 tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:27 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-19886291-821d-4a35-80f4-8c64c064cbd2 req-08ba2c55-4dd6-43c3-8c64-c36f312bda25 tempest-VolumesSnapshotsTestJSON-1130832246 None] Create snapshot completed successfully
Jun 18 11:31:27 devstack sudo[99440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b
Jun 18 11:31:27 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:28 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-3003ca68-9a48-4352-b017-c714e4213c46 req-22faabe3-027e-4e71-9b09-307974b5c4e8 tempest-AttachVolumeNegativeTest-1434192735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b" returned: 0 in 0.860s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-3003ca68-9a48-4352-b017-c714e4213c46 req-22faabe3-027e-4e71-9b09-307974b5c4e8 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.881s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-3003ca68-9a48-4352-b017-c714e4213c46 req-22faabe3-027e-4e71-9b09-307974b5c4e8 tempest-AttachVolumeNegativeTest-1434192735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75506367-571d-425b-90d4-ae81124109c3', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:31:28 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-3003ca68-9a48-4352-b017-c714e4213c46 req-22faabe3-027e-4e71-9b09-307974b5c4e8 tempest-AttachVolumeNegativeTest-1434192735 None] attachment_update completed successfully.
Jun 18 11:31:28 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] Acquiring lock "cinder-19b881ae-d66a-4d8f-adcc-c829c2204a1a-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:31:28 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "cinder-19b881ae-d66a-4d8f-adcc-c829c2204a1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:31:28 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] Acquiring lock "cinder-quobyte-d5c05404-f7b5-47ef-a4e9-480ee4763311" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:31:28 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "cinder-quobyte-d5c05404-f7b5-47ef-a4e9-480ee4763311" acquired by "delete_snapshot" :: waited 0.018s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:31:28 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] Acquiring lock "cinder-quobyte-19b881ae-d66a-4d8f-adcc-c829c2204a1a" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:31:28 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "cinder-quobyte-19b881ae-d66a-4d8f-adcc-c829c2204a1a" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:31:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] Deleting offline snapshot 19b881ae-d66a-4d8f-adcc-c829c2204a1a of volume d5c05404-f7b5-47ef-a4e9-480ee4763311 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:31:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] snapshot_file for this snap is: volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:31:28 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd344697-d802-4387-b7e0-f7bee356a6a9]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:28 devstack sudo[99450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a
Jun 18 11:31:28 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:29 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a" returned: 0 in 1.108s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5c05404-f7b5-47ef-a4e9-480ee4763311(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:31:29 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebea5c6-ffff-43bc-9907-5709e7cf7ee4]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:29 devstack sudo[99883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311
Jun 18 11:31:29 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:31 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311" returned: 0 in 1.348s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:31 devstack sudo[99911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a
Jun 18 11:31:31 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:32 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a" returned: 0 in 0.967s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:32 devstack sudo[99916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a
Jun 18 11:31:32 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:32 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311.19b881ae-d66a-4d8f-adcc-c829c2204a1a" returned: 0 in 0.819s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "cinder-quobyte-19b881ae-d66a-4d8f-adcc-c829c2204a1a" released by "_delete_snapshot" :: held 4.544s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:31:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "cinder-quobyte-d5c05404-f7b5-47ef-a4e9-480ee4763311" released by "delete_snapshot" :: held 4.617s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.quota [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] Created reservations ['08effdaf-185c-447d-a8a1-3e42a555a4da', '51e19c19-8a71-4d4f-9807-94527401925f', '63f03a79-ce35-4f9c-85a6-1e56767b6c3f', 'f8db4c3c-5e43-4f07-a90c-38074bdf9b9a'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:31:33 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] Delete snapshot completed successfully.
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-539294a3-d1e1-4ebf-b7cb-336f9427406b req-b9eea153-f78e-4e60-bf5e-79a4fa3b4b04 tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "cinder-19b881ae-d66a-4d8f-adcc-c829c2204a1a-delete_snapshot" released by "delete_snapshot" :: held 4.913s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Flow 'volume_create_manager' (c47864f5-960f-4a2c-a829-a4c68c11310e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37da83ff-d92d-465b-8ea7-98a260d1e338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37da83ff-d92d-465b-8ea7-98a260d1e338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-989653427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8dae085-695e-4dd9-a49a-af648b98b549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39055c699f943da80ef504b012833bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:31:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:31:33Z,use_quota=True,user_id='e0198d5e4a6f4502be5140bc38de1ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cedd55-f64b-4c06-834d-f2298b1ad068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cedd55-f64b-4c06-834d-f2298b1ad068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e6d85f-ec88-4f53-bb58-9d7a2e3db512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e6d85f-ec88-4f53-bb58-9d7a2e3db512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8dae085-695e-4dd9-a49a-af648b98b549', 'volume_name': 'volume-b8dae085-695e-4dd9-a49a-af648b98b549', 'volume_size': 2}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fed5bce-d314-4874-b5da-8f6e94412138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fed5bce-d314-4874-b5da-8f6e94412138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91960ce0-51a6-4fd8-9710-cb24a548dfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:33 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Volume b8dae085-695e-4dd9-a49a-af648b98b549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8dae085-695e-4dd9-a49a-af648b98b549', 'volume_size': 2}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-989653427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8dae085-695e-4dd9-a49a-af648b98b549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39055c699f943da80ef504b012833bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:31:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:31:33Z,use_quota=True,user_id='e0198d5e4a6f4502be5140bc38de1ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Creating volume b8dae085-695e-4dd9-a49a-af648b98b549 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:31:33 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:31:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b8dae085-695e-4dd9-a49a-af648b98b549 2147483648 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:33 devstack sudo[99919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b8dae085-695e-4dd9-a49a-af648b98b549 2147483648
Jun 18 11:31:33 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] Acquiring lock "cinder-d5c05404-f7b5-47ef-a4e9-480ee4763311-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:31:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "cinder-d5c05404-f7b5-47ef-a4e9-480ee4763311-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:31:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] Acquiring lock "cinder-quobyte-d5c05404-f7b5-47ef-a4e9-480ee4763311" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:31:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "cinder-quobyte-d5c05404-f7b5-47ef-a4e9-480ee4763311" acquired by "delete_volume" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:31:34 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ead3af-8e33-4c5d-8318-288503f83e15]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:34 devstack sudo[99924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311
Jun 18 11:31:34 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:34 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b8dae085-695e-4dd9-a49a-af648b98b549 2147483648" returned: 0 in 1.222s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:34 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=51,cinder:INSERT=15,cinder:UPDATE=56,cinder:DELETE=3 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:31:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b8dae085-695e-4dd9-a49a-af648b98b549 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:34 devstack sudo[99927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b8dae085-695e-4dd9-a49a-af648b98b549
Jun 18 11:31:34 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:35 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-c05a2214-f411-4f3e-b37c-9c127aff2ec3 req-227b5644-8d35-49ac-9cb5-fc63c4f8c4fb tempest-AttachVolumeNegativeTest-1434192735 None] Terminate volume connection completed successfully.
Jun 18 11:31:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-c05a2214-f411-4f3e-b37c-9c127aff2ec3 req-227b5644-8d35-49ac-9cb5-fc63c4f8c4fb tempest-AttachVolumeNegativeTest-1434192735 None] Deleting attachment 75506367-571d-425b-90d4-ae81124109c3. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:31:35 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311" returned: 0 in 1.131s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:35 devstack sudo[99960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311
Jun 18 11:31:35 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:35 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b8dae085-695e-4dd9-a49a-af648b98b549" returned: 0 in 0.952s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:35 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] <== create_volume: return (2249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:31:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.253s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91960ce0-51a6-4fd8-9710-cb24a548dfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8dae085-695e-4dd9-a49a-af648b98b549', 'volume_size': 2}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45de4641-ff00-4137-b03e-846e820e806a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:35 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Volume volume-b8dae085-695e-4dd9-a49a-af648b98b549 (b8dae085-695e-4dd9-a49a-af648b98b549): created successfully
Jun 18 11:31:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45de4641-ff00-4137-b03e-846e820e806a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Flow 'volume_create_manager' (c47864f5-960f-4a2c-a829-a4c68c11310e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:31:35 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-377fadda-9131-4fdd-92f4-3ed6089255d8 tempest-VolumesCloneNegativeTest-623961575 None] Created volume successfully.
Jun 18 11:31:36 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d5c05404-f7b5-47ef-a4e9-480ee4763311" returned: 0 in 0.901s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:36 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "cinder-quobyte-d5c05404-f7b5-47ef-a4e9-480ee4763311" released by "delete_volume" :: held 2.129s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:31:36 devstack cinder-volume[91663]: DEBUG cinder.quota [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] Created reservations ['08f96caf-957b-4dd8-a759-b816d3434a59', 'b16fd0b3-a9ee-4bd2-97f4-258b2e648140', '74b22aa8-95d3-4f31-807e-738a53918cd1', '46bd0df9-baf5-4bbf-980b-a1f6fbb78046'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:31:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:31:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:31:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:31:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:36 devstack sudo[99965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:31:36 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:36 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] Acquiring lock "cinder-b8dae085-695e-4dd9-a49a-af648b98b549-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:31:36 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] Lock "cinder-b8dae085-695e-4dd9-a49a-af648b98b549-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:31:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] Acquiring lock "cinder-quobyte-b8dae085-695e-4dd9-a49a-af648b98b549" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:31:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] Lock "cinder-quobyte-b8dae085-695e-4dd9-a49a-af648b98b549" acquired by "delete_volume" :: waited 0.027s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:31:37 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[377a3e5f-4594-4824-8506-6948bcf1fbf3]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b8dae085-695e-4dd9-a49a-af648b98b549 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:37 devstack sudo[99967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b8dae085-695e-4dd9-a49a-af648b98b549
Jun 18 11:31:37 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:37 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.163s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:37 devstack cinder-volume[91663]: DEBUG cinder.manager [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:31:37 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] Deleted volume successfully.
Jun 18 11:31:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-aa943b36-f74e-4551-8075-f30245d71099 req-54e7b927-4413-4ce5-a9f8-02edf2989098 tempest-VolumesSnapshotsTestJSON-1130832246 None] Lock "cinder-d5c05404-f7b5-47ef-a4e9-480ee4763311-delete_volume" released by "delete_volume" :: held 3.589s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:31:38 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b8dae085-695e-4dd9-a49a-af648b98b549" returned: 0 in 1.276s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b8dae085-695e-4dd9-a49a-af648b98b549 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:38 devstack sudo[99973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b8dae085-695e-4dd9-a49a-af648b98b549
Jun 18 11:31:38 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:39 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b8dae085-695e-4dd9-a49a-af648b98b549" returned: 0 in 1.415s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:39 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] Lock "cinder-quobyte-b8dae085-695e-4dd9-a49a-af648b98b549" released by "delete_volume" :: held 2.780s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:31:39 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:UPDATE=68,cinder:SELECT=55,cinder:INSERT=16,cinder:DELETE=6 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:31:39 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] Created reservations ['b105e337-0d8f-45e4-a618-6902f047b6ee', '873afa4a-376f-4ebe-93b8-4dd25c4ddcec', 'ef11c4e6-1cb5-4494-bda8-214a31a7b572', '3192310e-b558-4385-9890-f1e5d1c50d37'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:31:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:31:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:40 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:31:40 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:31:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:40 devstack sudo[100013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:31:40 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:41 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.271s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:41 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:31:41 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] Deleted volume successfully.
Jun 18 11:31:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-54c95fb3-ea29-414a-b64a-b56ae8c8a1bc tempest-VolumesCloneNegativeTest-623961575 None] Lock "cinder-b8dae085-695e-4dd9-a49a-af648b98b549-delete_volume" released by "delete_volume" :: held 4.455s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-8ed96a51-7542-480e-8875-ef3d25baa079 tempest-BackendsCapabilitiesAdminTestsJSON-389166073 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757827758789, 'free_capacity_gb': 1775.757827758789, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91663) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Flow 'volume_create_manager' (881872b9-7bdb-4f18-b240-d953ebde7a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b581e60-d30f-495e-bac3-ff7fbd04e7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b581e60-d30f-495e-bac3-ff7fbd04e7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1079395642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51f0de0-f9a1-435c-8772-a539cfe12345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89edb25c78df46a88a6c5faac100209a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:31:45Z,use_quota=True,user_id='7da25545428c42e9997937d0437fc0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380fe72a-b567-4182-9a04-42bf1ce8ea1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380fe72a-b567-4182-9a04-42bf1ce8ea1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275b10c4-3cd8-4b86-afd4-b96317319ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG cinder.image.glance [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Creating Keystone auth plugin from conf {{(pid=91663) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275b10c4-3cd8-4b86-afd4-b96317319ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b51f0de0-f9a1-435c-8772-a539cfe12345', 'volume_name': 'volume-b51f0de0-f9a1-435c-8772-a539cfe12345', 'volume_size': 1, 'image_id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767e7f9d16154dd1a44a1bc208ee9108', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'created_at': datetime.datetime(2026, 6, 18, 9, 18, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 18, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ffb52d490>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ea04c9-f75b-484c-96a2-5c41c830958b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ea04c9-f75b-484c-96a2-5c41c830958b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f016287-11c9-4f3b-a075-985f0c403630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:45 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Volume b51f0de0-f9a1-435c-8772-a539cfe12345: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b51f0de0-f9a1-435c-8772-a539cfe12345', 'volume_size': 1, 'image_id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767e7f9d16154dd1a44a1bc208ee9108', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'created_at': datetime.datetime(2026, 6, 18, 9, 18, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 18, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ffb52d490>}
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Trying to clone b51f0de0-f9a1-435c-8772-a539cfe12345 from image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 at location (None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}]). {{(pid=91663) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e8d79525-5cab-47dc-a00e-2539cab31685 tempest-BackendsCapabilitiesAdminTestsJSON-389166073 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757827758789, 'free_capacity_gb': 1775.757827758789, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91663) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_1f38c9jfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 18 11:31:45 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Image download 20.69 MB at 20.69 MB/s
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c1bcca-eea0-49bd-800e-9d54a19ac777]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_1f38c9jfdevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:45 devstack sudo[100050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_1f38c9jfdevstack@QuobyteHD
Jun 18 11:31:45 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:46 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_1f38c9jfdevstack@QuobyteHD" returned: 0 in 0.819s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:46 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Temporary image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 is fetched for user 7da25545428c42e9997937d0437fc0a1. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 18 11:31:46 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[855f98ba-267a-47e3-a9f3-05dff8471d7c]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_1f38c9jfdevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:46 devstack sudo[100055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_1f38c9jfdevstack@QuobyteHD
Jun 18 11:31:46 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:47 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_1f38c9jfdevstack@QuobyteHD" returned: 0 in 0.863s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:31:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1079395642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51f0de0-f9a1-435c-8772-a539cfe12345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89edb25c78df46a88a6c5faac100209a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:31:45Z,use_quota=True,user_id='7da25545428c42e9997937d0437fc0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:31:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Creating volume b51f0de0-f9a1-435c-8772-a539cfe12345 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:31:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:31:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:31:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:31:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:31:47 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:31:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:47 devstack sudo[100060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 1073741824
Jun 18 11:31:47 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:48 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 1073741824" returned: 0 in 0.912s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:48 devstack sudo[100066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345
Jun 18 11:31:48 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:49 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345" returned: 0 in 0.780s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:49 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:31:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:49 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Attempting download of 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 ((None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}])) to volume b51f0de0-f9a1-435c-8772-a539cfe12345. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 18 11:31:49 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1d1cd4-542b-4c12-8f0b-fb909cf7eab0]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_ogt68rs4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:49 devstack sudo[100073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_ogt68rs4
Jun 18 11:31:49 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:50 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_ogt68rs4" returned: 0 in 0.895s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_ogt68rs4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:50 devstack sudo[100077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_ogt68rs4
Jun 18 11:31:50 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:51 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_ogt68rs4" returned: 1 in 0.813s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_ogt68rs4' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:31:51 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa1a7f9-1b52-48db-b7eb-b510030c53a6]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_1f38c9jfdevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:51 devstack sudo[100081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_1f38c9jfdevstack@QuobyteHD
Jun 18 11:31:51 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:52 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_1f38c9jfdevstack@QuobyteHD" returned: 0 in 0.848s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:52 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 was qcow2, converting to raw {{(pid=91663) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 18 11:31:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_1f38c9jfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:52 devstack sudo[100087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_1f38c9jfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345
Jun 18 11:31:52 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:54 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_1f38c9jfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345" returned: 0 in 2.050s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:54 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_1f38c9jfdevstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:31:54 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Converted 112.00 MB image at 54.60 MB/s
Jun 18 11:31:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:54 devstack sudo[100096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 1G
Jun 18 11:31:54 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:54 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 1G" returned: 0 in 0.748s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:54 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7f922e-a778-47f2-b903-5da927262a8b]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:55 devstack sudo[100101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345
Jun 18 11:31:55 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:56 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345" returned: 0 in 1.163s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:56 devstack sudo[100107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345
Jun 18 11:31:56 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Flow 'volume_create_manager' (6c0407ef-1464-4902-8a8b-e64f2ef13c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde1f60d-55e4-4861-8824-b999bd060a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde1f60d-55e4-4861-8824-b999bd060a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-386225371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c9a1fd-a050-4e34-85d8-f96e730ef15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8871042cd744aff9a6aa18f1e312c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:31:56Z,use_quota=True,user_id='4b0df63a8d1948d7afedd8844cdaaec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cfcc090-c1a4-4774-ace4-af4c1051c48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cfcc090-c1a4-4774-ace4-af4c1051c48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8417f250-442a-4eab-86bc-1b074623b650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8417f250-442a-4eab-86bc-1b074623b650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7c9a1fd-a050-4e34-85d8-f96e730ef15e', 'volume_name': 'volume-e7c9a1fd-a050-4e34-85d8-f96e730ef15e', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e0416e-c5bb-447a-b403-b5a5d1d0efaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e0416e-c5bb-447a-b403-b5a5d1d0efaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b58644f-6b85-41fd-9a53-d9026857a66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:56 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Volume e7c9a1fd-a050-4e34-85d8-f96e730ef15e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7c9a1fd-a050-4e34-85d8-f96e730ef15e', 'volume_size': 1}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-386225371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c9a1fd-a050-4e34-85d8-f96e730ef15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8871042cd744aff9a6aa18f1e312c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:31:56Z,use_quota=True,user_id='4b0df63a8d1948d7afedd8844cdaaec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Creating volume e7c9a1fd-a050-4e34-85d8-f96e730ef15e {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:31:56 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:31:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e7c9a1fd-a050-4e34-85d8-f96e730ef15e 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:56 devstack sudo[100114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e7c9a1fd-a050-4e34-85d8-f96e730ef15e 1073741824
Jun 18 11:31:56 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:57 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345" returned: 1 in 0.950s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:31:57 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Downloaded image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 ((None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}])) to volume b51f0de0-f9a1-435c-8772-a539cfe12345 successfully. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 18 11:31:57 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Temporary image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 for user 7da25545428c42e9997937d0437fc0a1 is deleted. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 18 11:31:57 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Marking volume b51f0de0-f9a1-435c-8772-a539cfe12345 as bootable. {{(pid=91663) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 18 11:31:57 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Copying metadata from image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 to b51f0de0-f9a1-435c-8772-a539cfe12345. {{(pid=91663) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 18 11:31:57 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Creating volume glance metadata for volume b51f0de0-f9a1-435c-8772-a539cfe12345 backed by image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91663) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 18 11:31:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f016287-11c9-4f3b-a075-985f0c403630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b51f0de0-f9a1-435c-8772-a539cfe12345', 'volume_size': 1, 'image_id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767e7f9d16154dd1a44a1bc208ee9108', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'created_at': datetime.datetime(2026, 6, 18, 9, 18, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 18, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ffb52d490>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ac6795-7dfc-4744-9a97-a89552b28ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:57 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Volume volume-b51f0de0-f9a1-435c-8772-a539cfe12345 (b51f0de0-f9a1-435c-8772-a539cfe12345): created successfully
Jun 18 11:31:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ac6795-7dfc-4744-9a97-a89552b28ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Flow 'volume_create_manager' (881872b9-7bdb-4f18-b240-d953ebde7a85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:31:57 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-045396ff-2121-45ed-adf9-f43c170522ff tempest-VolumesExtendTest-1531387695 None] Created volume successfully.
Jun 18 11:31:57 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e7c9a1fd-a050-4e34-85d8-f96e730ef15e 1073741824" returned: 0 in 1.102s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e7c9a1fd-a050-4e34-85d8-f96e730ef15e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:57 devstack sudo[100136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e7c9a1fd-a050-4e34-85d8-f96e730ef15e
Jun 18 11:31:57 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:57 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-1153bce2-a94d-427e-ba97-adb8226d9b59 tempest-GroupsTest-226827111 None] Group tempest-Group1-265011625: creating
Jun 18 11:31:57 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-1153bce2-a94d-427e-ba97-adb8226d9b59 tempest-GroupsTest-226827111 None] Group tempest-Group1-265011625: created successfully
Jun 18 11:31:57 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-1153bce2-a94d-427e-ba97-adb8226d9b59 tempest-GroupsTest-226827111 None] Create group completed successfully.
Jun 18 11:31:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8f060e1e-f3f4-4a5d-a208-fe18a75ab4c4 tempest-VolumesExtendTest-1531387695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:31:58 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e7c9a1fd-a050-4e34-85d8-f96e730ef15e" returned: 0 in 0.646s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:31:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8f060e1e-f3f4-4a5d-a208-fe18a75ab4c4 tempest-VolumesExtendTest-1531387695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.133s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:31:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b58644f-6b85-41fd-9a53-d9026857a66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c9a1fd-a050-4e34-85d8-f96e730ef15e', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80cba767-e716-4250-b9f5-4b0afbee1ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:31:58 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Volume volume-e7c9a1fd-a050-4e34-85d8-f96e730ef15e (e7c9a1fd-a050-4e34-85d8-f96e730ef15e): created successfully
Jun 18 11:31:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80cba767-e716-4250-b9f5-4b0afbee1ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:31:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Flow 'volume_create_manager' (6c0407ef-1464-4902-8a8b-e64f2ef13c42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:31:58 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13b10f8-eff0-4f3e-b010-2774fd244927]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:31:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8f060e1e-f3f4-4a5d-a208-fe18a75ab4c4 tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:58 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-69933d2e-a3dc-49e6-b6ba-ea382c5b0b23 tempest-AttachVolumeShelveTestJSON-394038834 None] Created volume successfully.
Jun 18 11:31:58 devstack sudo[100139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345
Jun 18 11:31:58 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:59 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-b8fa7760-549f-4cd9-8a05-96929d9cfbee tempest-GroupsTest-226827111 None] Group tempest-Group2-649002665: creating
Jun 18 11:31:59 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8f060e1e-f3f4-4a5d-a208-fe18a75ab4c4 tempest-VolumesExtendTest-1531387695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345" returned: 0 in 0.781s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8f060e1e-f3f4-4a5d-a208-fe18a75ab4c4 tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:59 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-b8fa7760-549f-4cd9-8a05-96929d9cfbee tempest-GroupsTest-226827111 None] Group tempest-Group2-649002665: created successfully
Jun 18 11:31:59 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-b8fa7760-549f-4cd9-8a05-96929d9cfbee tempest-GroupsTest-226827111 None] Create group completed successfully.
Jun 18 11:31:59 devstack sudo[100143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345
Jun 18 11:31:59 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:31:59 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root
Jun 18 11:31:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8f060e1e-f3f4-4a5d-a208-fe18a75ab4c4 tempest-VolumesExtendTest-1531387695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345" returned: 1 in 0.777s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8f060e1e-f3f4-4a5d-a208-fe18a75ab4c4 tempest-VolumesExtendTest-1531387695 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:31:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8f060e1e-f3f4-4a5d-a208-fe18a75ab4c4 tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 2G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:31:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8f060e1e-f3f4-4a5d-a208-fe18a75ab4c4 tempest-VolumesExtendTest-1531387695 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 2G" returned: 0 in 0.067s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:31:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8f060e1e-f3f4-4a5d-a208-fe18a75ab4c4 tempest-VolumesExtendTest-1531387695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.680s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:31:59 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-8f060e1e-f3f4-4a5d-a208-fe18a75ab4c4 tempest-VolumesExtendTest-1531387695 None] Extend volume completed successfully.
Jun 18 11:32:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Acquiring lock "cinder-b51f0de0-f9a1-435c-8772-a539cfe12345-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Lock "cinder-b51f0de0-f9a1-435c-8772-a539cfe12345-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Acquiring lock "cinder-quobyte-b51f0de0-f9a1-435c-8772-a539cfe12345" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Lock "cinder-quobyte-b51f0de0-f9a1-435c-8772-a539cfe12345" acquired by "delete_volume" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:00 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b67a65-67d6-40c3-906b-925a5c5763b4]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:32:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:00 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:32:00 devstack sudo[100160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345
Jun 18 11:32:00 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Flow 'volume_create_manager' (484d4501-276a-41e2-a936-7ea75bffea1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:32:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d575d68b-7b0c-4451-a927-6755cbdded71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d575d68b-7b0c-4451-a927-6755cbdded71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2061243159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f7cb3c41-50ef-4978-8a0c-cdfa450d4b70,host='devstack@QuobyteHD#QuobyteHD',id=88630f83-271e-47ee-a558-c693b179f3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71fe22ff8a54b81aee33a2cb2257425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:32:01Z,use_quota=True,user_id='8154e54e51114e5582ff047c6d82fffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e84dd3be-7f81-4050-b478-47262a9bf70a),volume_type_id=e84dd3be-7f81-4050-b478-47262a9bf70a)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5357b697-aa2f-4843-af08-a00de56910e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5357b697-aa2f-4843-af08-a00de56910e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47263b2e-1bd4-44e3-9e97-52106572f7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47263b2e-1bd4-44e3-9e97-52106572f7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88630f83-271e-47ee-a558-c693b179f3a1', 'volume_name': 'volume-88630f83-271e-47ee-a558-c693b179f3a1', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17a6e28-9f77-4704-a592-cfaea9f6d5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17a6e28-9f77-4704-a592-cfaea9f6d5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a88b095-7b36-4a51-b774-f9f573a4aede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:01 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Volume 88630f83-271e-47ee-a558-c693b179f3a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88630f83-271e-47ee-a558-c693b179f3a1', 'volume_size': 1}
Jun 18 11:32:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f7cb3c41-50ef-4978-8a0c-cdfa450d4b70,created_at=2026-06-18T09:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2061243159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f7cb3c41-50ef-4978-8a0c-cdfa450d4b70,host='devstack@QuobyteHD#QuobyteHD',id=88630f83-271e-47ee-a558-c693b179f3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71fe22ff8a54b81aee33a2cb2257425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:32:01Z,use_quota=True,user_id='8154e54e51114e5582ff047c6d82fffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e84dd3be-7f81-4050-b478-47262a9bf70a),volume_type_id=e84dd3be-7f81-4050-b478-47262a9bf70a)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:32:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Creating volume 88630f83-271e-47ee-a558-c693b179f3a1 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:32:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:32:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:32:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:32:01 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:32:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-88630f83-271e-47ee-a558-c693b179f3a1 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:01 devstack sudo[100163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-88630f83-271e-47ee-a558-c693b179f3a1 1073741824
Jun 18 11:32:01 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:01 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345" returned: 0 in 1.068s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:02 devstack sudo[100216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345
Jun 18 11:32:02 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:02 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-88630f83-271e-47ee-a558-c693b179f3a1 1073741824" returned: 0 in 1.662s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-88630f83-271e-47ee-a558-c693b179f3a1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:02 devstack sudo[100258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-88630f83-271e-47ee-a558-c693b179f3a1
Jun 18 11:32:02 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:03 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-88630f83-271e-47ee-a558-c693b179f3a1" returned: 0 in 0.842s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] <== create_volume: return (2596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:32:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.615s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a88b095-7b36-4a51-b774-f9f573a4aede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88630f83-271e-47ee-a558-c693b179f3a1', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:03 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (982304e4-b4ad-49e5-ad2b-9b3506ee96bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345" returned: 1 in 1.926s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:32:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:03 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Volume volume-88630f83-271e-47ee-a558-c693b179f3a1 (88630f83-271e-47ee-a558-c693b179f3a1): created successfully
Jun 18 11:32:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (982304e4-b4ad-49e5-ad2b-9b3506ee96bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Flow 'volume_create_manager' (484d4501-276a-41e2-a936-7ea75bffea1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:32:03 devstack sudo[100287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345
Jun 18 11:32:03 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:03 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-a0607d04-9392-47dd-9016-3d08eb13c35f tempest-GroupsTest-226827111 None] Created volume successfully.
Jun 18 11:32:04 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b51f0de0-f9a1-435c-8772-a539cfe12345" returned: 0 in 0.844s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:04 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Lock "cinder-quobyte-b51f0de0-f9a1-435c-8772-a539cfe12345" released by "delete_volume" :: held 3.935s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:32:04 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Created reservations ['f0b2493d-2ede-4970-9839-eb8e6c805326', '78aaa686-a3e6-4ab0-b4e4-9b16b193d355', 'dab8ba88-176d-4c5b-8eb7-c169590518da', '35173c3b-c009-4b21-ac9d-bd383a27937a'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:32:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:04 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:32:04 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:32:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:04 devstack sudo[100296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:32:04 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:05 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.051s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:05 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:32:05 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Deleted volume successfully.
Jun 18 11:32:05 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-88e33f80-edbe-4277-9b7c-0b6061ee08d9 tempest-VolumesExtendTest-1531387695 None] Lock "cinder-b51f0de0-f9a1-435c-8772-a539cfe12345-delete_volume" released by "delete_volume" :: held 5.287s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Flow 'volume_create_manager' (0f2e0b04-0e43-4d4e-9856-bffd85128d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dbfa85-e31d-40b0-b212-35be778b7d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dbfa85-e31d-40b0-b212-35be778b7d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2087086905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a592c630-cd0d-4709-b7a1-3f20353adf04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89edb25c78df46a88a6c5faac100209a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:32:06Z,use_quota=True,user_id='7da25545428c42e9997937d0437fc0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df122b1f-a913-419e-b48a-38dbd29207f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df122b1f-a913-419e-b48a-38dbd29207f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0350b5-1b19-4ccc-af4e-4c119aaa1063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0350b5-1b19-4ccc-af4e-4c119aaa1063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a592c630-cd0d-4709-b7a1-3f20353adf04', 'volume_name': 'volume-a592c630-cd0d-4709-b7a1-3f20353adf04', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cbc0a4-83cf-4fd9-b6a1-c28f059faff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cbc0a4-83cf-4fd9-b6a1-c28f059faff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c2d0c9-85a9-4ff8-8052-3d3b1e93091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:06 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Volume a592c630-cd0d-4709-b7a1-3f20353adf04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a592c630-cd0d-4709-b7a1-3f20353adf04', 'volume_size': 1}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2087086905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a592c630-cd0d-4709-b7a1-3f20353adf04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89edb25c78df46a88a6c5faac100209a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:32:06Z,use_quota=True,user_id='7da25545428c42e9997937d0437fc0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Creating volume a592c630-cd0d-4709-b7a1-3f20353adf04 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:32:06 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:06 devstack sudo[100309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04 1073741824
Jun 18 11:32:06 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] Acquiring lock "cinder-quobyte-88630f83-271e-47ee-a558-c693b179f3a1" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] Lock "cinder-quobyte-88630f83-271e-47ee-a558-c693b179f3a1" acquired by "delete_volume" :: waited 0.036s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ceee00-3237-4346-8d16-9d46b1bf7fac]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:32:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-88630f83-271e-47ee-a558-c693b179f3a1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:06 devstack sudo[100311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-88630f83-271e-47ee-a558-c693b179f3a1
Jun 18 11:32:06 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:07 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-88630f83-271e-47ee-a558-c693b179f3a1" returned: 0 in 1.320s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-88630f83-271e-47ee-a558-c693b179f3a1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:07 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04 1073741824" returned: 0 in 1.527s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:07 devstack sudo[100320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-88630f83-271e-47ee-a558-c693b179f3a1
Jun 18 11:32:07 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:08 devstack sudo[100322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04
Jun 18 11:32:08 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:08 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04" returned: 0 in 0.935s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] <== create_volume: return (2525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:32:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.536s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c2d0c9-85a9-4ff8-8052-3d3b1e93091d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a592c630-cd0d-4709-b7a1-3f20353adf04', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa16c8b-d906-4dd1-8624-ad8aeda050a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:09 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Volume volume-a592c630-cd0d-4709-b7a1-3f20353adf04 (a592c630-cd0d-4709-b7a1-3f20353adf04): created successfully
Jun 18 11:32:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa16c8b-d906-4dd1-8624-ad8aeda050a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:09 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Flow 'volume_create_manager' (0f2e0b04-0e43-4d4e-9856-bffd85128d4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:32:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-88630f83-271e-47ee-a558-c693b179f3a1" returned: 0 in 1.190s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:09 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-52703b46-4aa0-4da0-b7f8-6d0b6f3df545 tempest-VolumesExtendTest-1531387695 None] Created volume successfully.
Jun 18 11:32:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] Lock "cinder-quobyte-88630f83-271e-47ee-a558-c693b179f3a1" released by "delete_volume" :: held 2.596s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:32:09 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] Created reservations ['ba46b136-3ec7-43fa-acec-027652a9b956'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:32:09 devstack cinder-volume[91663]: WARNING cinder.quota [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-460923967 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-460923967, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:32:09 devstack cinder-volume[91663]: WARNING cinder.quota [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-460923967 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-460923967, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:32:09 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] Created reservations ['085d5a7c-6014-4038-8cbe-e63932a8ac15', '35e87df3-f1f2-4bf5-8a16-36165ed3dcd3', 'a6e885d0-891f-433f-b6bb-0e146a0ddd4d', '6bf42460-4864-44c4-9d6d-73c64e97f4c8'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:32:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:32:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:32:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:09 devstack sudo[100328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:32:09 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] Creating offline snapshot e84f7134-ad7b-4131-8275-1e3ae43ea0c0 of volume a592c630-cd0d-4709-b7a1-3f20353adf04 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:32:10 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfff8c8-44a7-4912-9076-4e5626c43412]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:32:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:10 devstack sudo[100330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04
Jun 18 11:32:10 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:10 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-45377760-fcc9-4ba3-bbb6-5d9f929bee97 tempest-GroupsTest-226827111 None] Created reservations ['f365e7ab-7669-4461-8e8a-0fd2e4efad33'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:32:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-45377760-fcc9-4ba3-bbb6-5d9f929bee97 tempest-GroupsTest-226827111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-45377760-fcc9-4ba3-bbb6-5d9f929bee97 tempest-GroupsTest-226827111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-45377760-fcc9-4ba3-bbb6-5d9f929bee97 tempest-GroupsTest-226827111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:32:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-45377760-fcc9-4ba3-bbb6-5d9f929bee97 tempest-GroupsTest-226827111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:32:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-45377760-fcc9-4ba3-bbb6-5d9f929bee97 tempest-GroupsTest-226827111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-45377760-fcc9-4ba3-bbb6-5d9f929bee97 tempest-GroupsTest-226827111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:10 devstack sudo[100333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:32:10 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:10 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.245s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:10 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:32:10 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-0c92bb0c-c4d3-49c9-a45c-03c0e40f1715 tempest-GroupsTest-226827111 None] Delete group completed successfully.
Jun 18 11:32:11 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04" returned: 0 in 1.286s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:11 devstack sudo[100338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0 1G
Jun 18 11:32:11 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:11 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-45377760-fcc9-4ba3-bbb6-5d9f929bee97 tempest-GroupsTest-226827111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.841s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:11 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-45377760-fcc9-4ba3-bbb6-5d9f929bee97 tempest-GroupsTest-226827111 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:32:11 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-45377760-fcc9-4ba3-bbb6-5d9f929bee97 tempest-GroupsTest-226827111 None] Delete group completed successfully.
Jun 18 11:32:12 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-5e46dafc-2bb9-4990-ba24-da05aa5808af tempest-GroupsTest-226827111 None] Group tempest-GroupsTest-Group-1313491340: creating
Jun 18 11:32:12 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0 1G" returned: 0 in 1.004s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a592c630-cd0d-4709-b7a1-3f20353adf04 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:12 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-5e46dafc-2bb9-4990-ba24-da05aa5808af tempest-GroupsTest-226827111 None] Group tempest-GroupsTest-Group-1313491340: created successfully
Jun 18 11:32:12 devstack sudo[100346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a592c630-cd0d-4709-b7a1-3f20353adf04 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0
Jun 18 11:32:12 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:12 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-5e46dafc-2bb9-4990-ba24-da05aa5808af tempest-GroupsTest-226827111 None] Create group completed successfully.
Jun 18 11:32:13 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a592c630-cd0d-4709-b7a1-3f20353adf04 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0" returned: 0 in 0.755s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:13 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0 is being set with open permissions: ugo+rw
Jun 18 11:32:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:13 devstack sudo[100352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0
Jun 18 11:32:13 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:13 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0" returned: 0 in 0.711s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:13 devstack sudo[100355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.info
Jun 18 11:32:13 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:14 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:32:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Flow 'volume_create_manager' (c940a000-1161-4aca-bc1d-1061aec2d48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:32:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a2be35-af66-4a6b-b6a0-92a7ee75df8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a2be35-af66-4a6b-b6a0-92a7ee75df8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1206996543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a228c89-e28b-4d0b-a011-6617a2b503a3,host='devstack@QuobyteHD#QuobyteHD',id=22df1775-618a-4fc7-bd76-1618273ade5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71fe22ff8a54b81aee33a2cb2257425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:32:14Z,use_quota=True,user_id='8154e54e51114e5582ff047c6d82fffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cef4645-adc5-41bd-8beb-a37884554b86),volume_type_id=5cef4645-adc5-41bd-8beb-a37884554b86)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26bac1a4-6c7e-4197-be3b-c6d4e8cd0ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26bac1a4-6c7e-4197-be3b-c6d4e8cd0ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a79995-4388-4d21-9973-ece9ff2a4f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a79995-4388-4d21-9973-ece9ff2a4f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22df1775-618a-4fc7-bd76-1618273ade5d', 'volume_name': 'volume-22df1775-618a-4fc7-bd76-1618273ade5d', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79022d66-ce76-4c7d-ae0c-b2c1b9f895ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79022d66-ce76-4c7d-ae0c-b2c1b9f895ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99e6883-4331-4d54-8b86-8bfb6196bbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:14 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Volume 22df1775-618a-4fc7-bd76-1618273ade5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22df1775-618a-4fc7-bd76-1618273ade5d', 'volume_size': 1}
Jun 18 11:32:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:14 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.info" returned: 0 in 0.782s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:14 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.info is being set with open permissions: ugo+rw
Jun 18 11:32:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:14 devstack sudo[100358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.info
Jun 18 11:32:14 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:15 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.info" returned: 0 in 0.696s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.419s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.219s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5a228c89-e28b-4d0b-a011-6617a2b503a3,created_at=2026-06-18T09:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1206996543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a228c89-e28b-4d0b-a011-6617a2b503a3,host='devstack@QuobyteHD#QuobyteHD',id=22df1775-618a-4fc7-bd76-1618273ade5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71fe22ff8a54b81aee33a2cb2257425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:32:14Z,use_quota=True,user_id='8154e54e51114e5582ff047c6d82fffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cef4645-adc5-41bd-8beb-a37884554b86),volume_type_id=5cef4645-adc5-41bd-8beb-a37884554b86)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:32:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Creating volume 22df1775-618a-4fc7-bd76-1618273ade5d {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:32:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:32:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:32:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:32:15 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:32:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-22df1775-618a-4fc7-bd76-1618273ade5d 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:15 devstack sudo[100369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-22df1775-618a-4fc7-bd76-1618273ade5d 1073741824
Jun 18 11:32:15 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:15 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-2456e390-e521-465f-8bfd-931f356c66c5 tempest-VolumesExtendTest-1531387695 None] Create snapshot completed successfully
Jun 18 11:32:16 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-22df1775-618a-4fc7-bd76-1618273ade5d 1073741824" returned: 0 in 1.114s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-22df1775-618a-4fc7-bd76-1618273ade5d {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9bc3bb14-5a55-4e95-a767-fba7f79ce597 tempest-VolumesExtendTest-1531387695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:16 devstack sudo[100431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-22df1775-618a-4fc7-bd76-1618273ade5d
Jun 18 11:32:16 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:17 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-22df1775-618a-4fc7-bd76-1618273ade5d" returned: 0 in 0.666s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:32:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9bc3bb14-5a55-4e95-a767-fba7f79ce597 tempest-VolumesExtendTest-1531387695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.642s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99e6883-4331-4d54-8b86-8bfb6196bbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22df1775-618a-4fc7-bd76-1618273ade5d', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1b91f3-aff1-4167-8d17-1fe99797636a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:17 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a758bd3-c2da-47d5-8573-15c2e6b85b59]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:32:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9bc3bb14-5a55-4e95-a767-fba7f79ce597 tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:17 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Volume volume-22df1775-618a-4fc7-bd76-1618273ade5d (22df1775-618a-4fc7-bd76-1618273ade5d): created successfully
Jun 18 11:32:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1b91f3-aff1-4167-8d17-1fe99797636a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Flow 'volume_create_manager' (c940a000-1161-4aca-bc1d-1061aec2d48d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:32:17 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-ceec4ce7-ec89-438f-8899-bc669a61a87f tempest-GroupsTest-226827111 None] Created volume successfully.
Jun 18 11:32:17 devstack sudo[100434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04
Jun 18 11:32:17 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-9635616c-8a4d-4281-b253-d9d8999458d6 req-7b0bed29-aa73-4856-a927-0225cbfea2f9 tempest-AttachVolumeShelveTestJSON-394038834 None] No connector for attachment 8f22886c-6eb4-4dc6-99f8-86df99d4b014; skipping storage backend terminate_connection call. {{(pid=91663) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jun 18 11:32:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-9635616c-8a4d-4281-b253-d9d8999458d6 req-7b0bed29-aa73-4856-a927-0225cbfea2f9 tempest-AttachVolumeShelveTestJSON-394038834 None] Deleting attachment 8f22886c-6eb4-4dc6-99f8-86df99d4b014. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:32:18 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9bc3bb14-5a55-4e95-a767-fba7f79ce597 tempest-VolumesExtendTest-1531387695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04" returned: 0 in 0.784s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9bc3bb14-5a55-4e95-a767-fba7f79ce597 tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0 2G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9bc3bb14-5a55-4e95-a767-fba7f79ce597 tempest-VolumesExtendTest-1531387695 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0 2G" returned: 0 in 0.148s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9bc3bb14-5a55-4e95-a767-fba7f79ce597 tempest-VolumesExtendTest-1531387695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.973s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:18 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-9bc3bb14-5a55-4e95-a767-fba7f79ce597 tempest-VolumesExtendTest-1531387695 None] Extend volume completed successfully.
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Flow 'volume_create_manager' (96a6c93b-e5cb-4feb-a0e3-c5c22c20a8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de49d066-6e21-463d-b893-6f0b83d4a7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de49d066-6e21-463d-b893-6f0b83d4a7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-795932475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a228c89-e28b-4d0b-a011-6617a2b503a3,host='devstack@QuobyteHD#QuobyteHD',id=f9e9987b-2183-4775-91b0-464abd17434b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71fe22ff8a54b81aee33a2cb2257425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:32:18Z,use_quota=True,user_id='8154e54e51114e5582ff047c6d82fffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cef4645-adc5-41bd-8beb-a37884554b86),volume_type_id=5cef4645-adc5-41bd-8beb-a37884554b86)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0020dad-f8a8-4fdb-917a-78b9ac49d13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0020dad-f8a8-4fdb-917a-78b9ac49d13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f4bcfb-7450-4b43-8f55-3762d7d082d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f4bcfb-7450-4b43-8f55-3762d7d082d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e9987b-2183-4775-91b0-464abd17434b', 'volume_name': 'volume-f9e9987b-2183-4775-91b0-464abd17434b', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913239b0-b86d-4841-be85-e97c12bb0d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913239b0-b86d-4841-be85-e97c12bb0d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4fe1bb-fb3c-46b2-92d0-d753a2906656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:18 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Volume f9e9987b-2183-4775-91b0-464abd17434b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e9987b-2183-4775-91b0-464abd17434b', 'volume_size': 1}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5a228c89-e28b-4d0b-a011-6617a2b503a3,created_at=2026-06-18T09:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-795932475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a228c89-e28b-4d0b-a011-6617a2b503a3,host='devstack@QuobyteHD#QuobyteHD',id=f9e9987b-2183-4775-91b0-464abd17434b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71fe22ff8a54b81aee33a2cb2257425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:32:18Z,use_quota=True,user_id='8154e54e51114e5582ff047c6d82fffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cef4645-adc5-41bd-8beb-a37884554b86),volume_type_id=5cef4645-adc5-41bd-8beb-a37884554b86)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Creating volume f9e9987b-2183-4775-91b0-464abd17434b {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:32:18 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:32:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f9e9987b-2183-4775-91b0-464abd17434b 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:18 devstack sudo[100443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f9e9987b-2183-4775-91b0-464abd17434b 1073741824
Jun 18 11:32:18 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] Acquiring lock "cinder-e84f7134-ad7b-4131-8275-1e3ae43ea0c0-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] Lock "cinder-e84f7134-ad7b-4131-8275-1e3ae43ea0c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] Acquiring lock "cinder-quobyte-a592c630-cd0d-4709-b7a1-3f20353adf04" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] Lock "cinder-quobyte-a592c630-cd0d-4709-b7a1-3f20353adf04" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] Acquiring lock "cinder-quobyte-e84f7134-ad7b-4131-8275-1e3ae43ea0c0" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] Lock "cinder-quobyte-e84f7134-ad7b-4131-8275-1e3ae43ea0c0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] Deleting offline snapshot e84f7134-ad7b-4131-8275-1e3ae43ea0c0 of volume a592c630-cd0d-4709-b7a1-3f20353adf04 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:32:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] snapshot_file for this snap is: volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:32:19 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[64842ba2-faa8-4041-8bd2-8dd4f28ca4df]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:32:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:19 devstack sudo[100446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0
Jun 18 11:32:19 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:19 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f9e9987b-2183-4775-91b0-464abd17434b 1073741824" returned: 0 in 0.967s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f9e9987b-2183-4775-91b0-464abd17434b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:19 devstack sudo[100454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f9e9987b-2183-4775-91b0-464abd17434b
Jun 18 11:32:19 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:19 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0" returned: 0 in 0.823s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a592c630-cd0d-4709-b7a1-3f20353adf04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:32:19 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f492580-1aa1-4ab3-add3-1db86df74ce5]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:32:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:20 devstack sudo[100460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04
Jun 18 11:32:20 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:20 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f9e9987b-2183-4775-91b0-464abd17434b" returned: 0 in 0.729s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:20 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:32:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4fe1bb-fb3c-46b2-92d0-d753a2906656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e9987b-2183-4775-91b0-464abd17434b', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404359ee-2a74-4748-a138-68e26bcb8871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:20 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Volume volume-f9e9987b-2183-4775-91b0-464abd17434b (f9e9987b-2183-4775-91b0-464abd17434b): created successfully
Jun 18 11:32:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404359ee-2a74-4748-a138-68e26bcb8871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Flow 'volume_create_manager' (96a6c93b-e5cb-4feb-a0e3-c5c22c20a8af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:32:20 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-f61eaf11-04c0-41e0-be50-4d9ef128ad3c tempest-GroupsTest-226827111 None] Created volume successfully.
Jun 18 11:32:20 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04" returned: 0 in 0.801s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:20 devstack sudo[100467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0
Jun 18 11:32:20 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:21 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-fe071584-994a-4e66-a1b3-5e27a04f2a6c tempest-GroupsTest-226827111 None] Update group completed successfully.
Jun 18 11:32:21 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0" returned: 0 in 0.772s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:21 devstack sudo[100473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0
Jun 18 11:32:21 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:22 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04.e84f7134-ad7b-4131-8275-1e3ae43ea0c0" returned: 0 in 0.681s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] Lock "cinder-quobyte-e84f7134-ad7b-4131-8275-1e3ae43ea0c0" released by "_delete_snapshot" :: held 3.219s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:32:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] Lock "cinder-quobyte-a592c630-cd0d-4709-b7a1-3f20353adf04" released by "delete_snapshot" :: held 3.242s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:32:22 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] Created reservations ['656284b6-03a5-486f-92f6-70dc924c2bb7', 'b040f1c5-da23-49a4-95c0-995ef99b2552', 'b7453d8d-dd26-4347-93a2-72290dd53bb8', 'aa65a4a2-1ea7-4fa7-a84e-e33240286df6'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:32:22 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d1ce4c85-0f84-4a39-9a42-dbc2de8ef6c4 tempest-GroupsTest-226827111 None] Update group completed successfully.
Jun 18 11:32:22 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] Delete snapshot completed successfully.
Jun 18 11:32:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-843f3a33-b450-495d-babc-09ea75f6e57f tempest-VolumesExtendTest-1531387695 None] Lock "cinder-e84f7134-ad7b-4131-8275-1e3ae43ea0c0-delete_snapshot" released by "delete_snapshot" :: held 3.433s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:32:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] Acquiring lock "cinder-a592c630-cd0d-4709-b7a1-3f20353adf04-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] Lock "cinder-a592c630-cd0d-4709-b7a1-3f20353adf04-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] Acquiring lock "cinder-quobyte-a592c630-cd0d-4709-b7a1-3f20353adf04" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] Lock "cinder-quobyte-a592c630-cd0d-4709-b7a1-3f20353adf04" acquired by "delete_volume" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:23 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b27d18f-293c-4f4d-b6b8-686eca1a0133]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:32:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:23 devstack sudo[100476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04
Jun 18 11:32:23 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Acquiring lock "cinder-quobyte-22df1775-618a-4fc7-bd76-1618273ade5d" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Lock "cinder-quobyte-22df1775-618a-4fc7-bd76-1618273ade5d" acquired by "delete_volume" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:24 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7d6a58-b68d-455b-93b3-e5b07a121868]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:32:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-22df1775-618a-4fc7-bd76-1618273ade5d {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:24 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04" returned: 0 in 0.823s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:24 devstack sudo[100482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04
Jun 18 11:32:24 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:24 devstack sudo[100481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-22df1775-618a-4fc7-bd76-1618273ade5d
Jun 18 11:32:24 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:24 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a592c630-cd0d-4709-b7a1-3f20353adf04" returned: 0 in 0.658s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] Lock "cinder-quobyte-a592c630-cd0d-4709-b7a1-3f20353adf04" released by "delete_volume" :: held 1.532s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:32:24 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-22df1775-618a-4fc7-bd76-1618273ade5d" returned: 0 in 0.806s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-22df1775-618a-4fc7-bd76-1618273ade5d {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:24 devstack sudo[100489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-22df1775-618a-4fc7-bd76-1618273ade5d
Jun 18 11:32:24 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:24 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] Created reservations ['3c55c1dd-7813-4a80-972e-64fe3b872162', '8af2dd5a-c5e2-4c6e-a852-005b14914633', '8ce1c0b8-1079-4f5e-a2e2-584b1c8248ad', '0126b81c-793a-41d3-bda7-384ce7a121f0'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:25 devstack sudo[100491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:32:25 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:25 devstack sudo[100493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:32:25 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:25 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-22df1775-618a-4fc7-bd76-1618273ade5d" returned: 0 in 0.849s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Lock "cinder-quobyte-22df1775-618a-4fc7-bd76-1618273ade5d" released by "delete_volume" :: held 1.720s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Acquiring lock "cinder-quobyte-f9e9987b-2183-4775-91b0-464abd17434b" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Lock "cinder-quobyte-f9e9987b-2183-4775-91b0-464abd17434b" acquired by "delete_volume" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:25 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.832s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[05367d11-7c0d-42cd-8dd2-11b29057f5e5]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f9e9987b-2183-4775-91b0-464abd17434b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:25 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] Deleted volume successfully.
Jun 18 11:32:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a6a66140-f758-4bd7-bbb2-052c02a8d99e tempest-VolumesExtendTest-1531387695 None] Lock "cinder-a592c630-cd0d-4709-b7a1-3f20353adf04-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:32:26 devstack sudo[100497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f9e9987b-2183-4775-91b0-464abd17434b
Jun 18 11:32:26 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:26 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.805s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:32:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:32:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:32:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:32:26 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f9e9987b-2183-4775-91b0-464abd17434b" returned: 0 in 0.987s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f9e9987b-2183-4775-91b0-464abd17434b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:26 devstack sudo[100504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f9e9987b-2183-4775-91b0-464abd17434b
Jun 18 11:32:26 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:27 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f9e9987b-2183-4775-91b0-464abd17434b" returned: 0 in 0.751s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:27 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Lock "cinder-quobyte-f9e9987b-2183-4775-91b0-464abd17434b" released by "delete_volume" :: held 1.793s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:32:27 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Created reservations ['4c97a270-62c3-435b-937d-9e55929416d0'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:32:27 devstack cinder-volume[91663]: WARNING cinder.quota [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-840305453 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-840305453, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:32:27 devstack cinder-volume[91663]: WARNING cinder.quota [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-840305453 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-840305453, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:32:27 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Created reservations ['184f70e8-3857-4115-b089-364e069e7f93', '2bc22400-833a-40f7-baa2-18967cfea975', '98e311f5-ec0b-4a88-9bc6-d26b48cb08ff', '3a459e2b-ab21-415d-bf9e-2b8188ed9e54'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:32:27 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Created reservations ['cdba90e7-8665-45b4-a2e9-73984573f1c6', 'c1ffa138-205d-4da2-9ccf-4d82b64a0f04', 'c679f28d-e10e-46ec-a8f1-63d204bfa3db', '30ecd36e-5eaa-4a30-ba79-1eb45fffe515'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:28 devstack sudo[100509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:32:28 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Flow 'volume_create_manager' (a433161b-7421-409e-b41c-51fc97b038ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c225f9-766a-40cf-951f-28a58c63669c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c225f9-766a-40cf-951f-28a58c63669c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1193282895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfca698e-d011-4d74-966f-69ef521995d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb6fa69b6433ca38923d4961f63a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:32:29Z,use_quota=True,user_id='52ccb25475e344ef9b3ceedc0909c1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1c2caa-fd57-4ce2-92d4-e1da7dd91d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1c2caa-fd57-4ce2-92d4-e1da7dd91d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a43386-00a3-432f-abe5-acc2f9497235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a43386-00a3-432f-abe5-acc2f9497235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfca698e-d011-4d74-966f-69ef521995d7', 'volume_name': 'volume-cfca698e-d011-4d74-966f-69ef521995d7', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22fcb33-2f0e-4390-9ee6-56ac07b4115c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22fcb33-2f0e-4390-9ee6-56ac07b4115c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bec1a3e-a89b-45a4-8af9-c221b5234711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:28 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Volume cfca698e-d011-4d74-966f-69ef521995d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfca698e-d011-4d74-966f-69ef521995d7', 'volume_size': 1}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1193282895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfca698e-d011-4d74-966f-69ef521995d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bb6fa69b6433ca38923d4961f63a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:32:29Z,use_quota=True,user_id='52ccb25475e344ef9b3ceedc0909c1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Creating volume cfca698e-d011-4d74-966f-69ef521995d7 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:32:28 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cfca698e-d011-4d74-966f-69ef521995d7 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:28 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.741s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:28 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:32:28 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-ad3f262e-89bf-47c6-aa03-e341952be427 tempest-GroupsTest-226827111 None] Delete group completed successfully.
Jun 18 11:32:28 devstack sudo[100512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cfca698e-d011-4d74-966f-69ef521995d7 1073741824
Jun 18 11:32:28 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:30 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cfca698e-d011-4d74-966f-69ef521995d7 1073741824" returned: 0 in 1.376s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cfca698e-d011-4d74-966f-69ef521995d7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:30 devstack sudo[100519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cfca698e-d011-4d74-966f-69ef521995d7
Jun 18 11:32:30 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:31 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cfca698e-d011-4d74-966f-69ef521995d7" returned: 0 in 0.953s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:31 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] <== create_volume: return (2401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:32:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.404s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bec1a3e-a89b-45a4-8af9-c221b5234711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfca698e-d011-4d74-966f-69ef521995d7', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac96b259-bb7b-42f1-82e4-3e688bb90110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:31 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Volume volume-cfca698e-d011-4d74-966f-69ef521995d7 (cfca698e-d011-4d74-966f-69ef521995d7): created successfully
Jun 18 11:32:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac96b259-bb7b-42f1-82e4-3e688bb90110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Flow 'volume_create_manager' (a433161b-7421-409e-b41c-51fc97b038ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:32:31 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-dbdb6ddc-0a93-4add-b715-ed28182b59f2 tempest-AttachVolumeNegativeTest-1434192735 None] Created volume successfully.
Jun 18 11:32:35 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=99,cinder:UPDATE=97,cinder:DELETE=6,cinder:INSERT=27 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:32:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-8cb8b118-d7ee-4ed7-8089-67bf426e1199 req-b92aa17e-2ac3-4001-ac99-e49d17ac60cb tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-8cb8b118-d7ee-4ed7-8089-67bf426e1199 req-b92aa17e-2ac3-4001-ac99-e49d17ac60cb tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:35 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[096cbc1e-141d-438b-a791-314dc10fbce3]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:32:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-8cb8b118-d7ee-4ed7-8089-67bf426e1199 req-b92aa17e-2ac3-4001-ac99-e49d17ac60cb tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cfca698e-d011-4d74-966f-69ef521995d7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:35 devstack sudo[100566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cfca698e-d011-4d74-966f-69ef521995d7
Jun 18 11:32:35 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Flow 'volume_create_manager' (2d1c63d6-a13e-447a-abab-bd9650724181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94d8a46-fd12-4ff7-8ee2-3011255b513d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:36 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94d8a46-fd12-4ff7-8ee2-3011255b513d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1388222404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ed244d-19af-48be-bfe7-4771fa27fdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebd8e0cab644d5b85f19c37a46e55b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:32:37Z,use_quota=True,user_id='52f383179281444f85cc9f0ad578322e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd9eee8-a938-4bcf-adbc-9053988514bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd9eee8-a938-4bcf-adbc-9053988514bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ef9092-dc9b-4b40-9514-37e92fd04ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ef9092-dc9b-4b40-9514-37e92fd04ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ed244d-19af-48be-bfe7-4771fa27fdd5', 'volume_name': 'volume-70ed244d-19af-48be-bfe7-4771fa27fdd5', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c367f71-561a-4fea-b3a7-c7a877dcf271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c367f71-561a-4fea-b3a7-c7a877dcf271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006160fd-848e-414e-8139-76b74c5b07dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:36 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Volume 70ed244d-19af-48be-bfe7-4771fa27fdd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ed244d-19af-48be-bfe7-4771fa27fdd5', 'volume_size': 1}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-8cb8b118-d7ee-4ed7-8089-67bf426e1199 req-b92aa17e-2ac3-4001-ac99-e49d17ac60cb tempest-AttachVolumeNegativeTest-1434192735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cfca698e-d011-4d74-966f-69ef521995d7" returned: 0 in 1.034s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-8cb8b118-d7ee-4ed7-8089-67bf426e1199 req-b92aa17e-2ac3-4001-ac99-e49d17ac60cb tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.060s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1388222404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ed244d-19af-48be-bfe7-4771fa27fdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebd8e0cab644d5b85f19c37a46e55b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:32:37Z,use_quota=True,user_id='52f383179281444f85cc9f0ad578322e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Creating volume 70ed244d-19af-48be-bfe7-4771fa27fdd5 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:32:36 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:36 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5 1073741824
Jun 18 11:32:36 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:36 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-8cb8b118-d7ee-4ed7-8089-67bf426e1199 req-b92aa17e-2ac3-4001-ac99-e49d17ac60cb tempest-AttachVolumeNegativeTest-1434192735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-cfca698e-d011-4d74-966f-69ef521995d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '761cfd83-4916-4bf4-bc00-c6ad8a47a1cb', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:32:36 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-8cb8b118-d7ee-4ed7-8089-67bf426e1199 req-b92aa17e-2ac3-4001-ac99-e49d17ac60cb tempest-AttachVolumeNegativeTest-1434192735 None] attachment_update completed successfully.
Jun 18 11:32:37 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5 1073741824" returned: 0 in 1.063s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:37 devstack sudo[100648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5
Jun 18 11:32:37 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:38 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5" returned: 0 in 1.132s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] <== create_volume: return (2254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:32:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.257s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006160fd-848e-414e-8139-76b74c5b07dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ed244d-19af-48be-bfe7-4771fa27fdd5', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52272bad-9550-4fd6-b61f-b3e7e46ce4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:32:39 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Volume volume-70ed244d-19af-48be-bfe7-4771fa27fdd5 (70ed244d-19af-48be-bfe7-4771fa27fdd5): created successfully
Jun 18 11:32:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52272bad-9550-4fd6-b61f-b3e7e46ce4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:32:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Flow 'volume_create_manager' (2d1c63d6-a13e-447a-abab-bd9650724181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:32:39 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-5d51010a-e546-418c-aea9-3585141bda3f tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Created volume successfully.
Jun 18 11:32:40 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:INSERT=27,cinder:UPDATE=106,cinder:SELECT=87,cinder:DELETE=7 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:32:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:40 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Creating offline snapshot c85bd4bc-e86c-43be-8721-e396806420a4 of volume 70ed244d-19af-48be-bfe7-4771fa27fdd5 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:32:40 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9bfddd-5b80-4dfc-b921-cd914d1c3b00]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:32:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:40 devstack sudo[101032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5
Jun 18 11:32:40 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:41 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5" returned: 0 in 1.185s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:41 devstack sudo[101039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4 1G
Jun 18 11:32:41 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:42 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4 1G" returned: 0 in 1.167s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ed244d-19af-48be-bfe7-4771fa27fdd5 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:42 devstack sudo[101045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ed244d-19af-48be-bfe7-4771fa27fdd5 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4
Jun 18 11:32:42 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:43 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ed244d-19af-48be-bfe7-4771fa27fdd5 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4" returned: 0 in 0.893s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:43 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4 is being set with open permissions: ugo+rw
Jun 18 11:32:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:43 devstack sudo[101051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4
Jun 18 11:32:43 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:44 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-3121093c-0c0b-4b67-9e26-3e5ef5304d1d req-7ed911c5-514d-42af-81c1-f19a1d94fef7 tempest-AttachVolumeNegativeTest-1434192735 None] Terminate volume connection completed successfully.
Jun 18 11:32:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-3121093c-0c0b-4b67-9e26-3e5ef5304d1d req-7ed911c5-514d-42af-81c1-f19a1d94fef7 tempest-AttachVolumeNegativeTest-1434192735 None] Deleting attachment 761cfd83-4916-4bf4-bc00-c6ad8a47a1cb. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:32:44 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4" returned: 0 in 0.780s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:44 devstack sudo[101083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.info
Jun 18 11:32:44 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:45 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.info" returned: 0 in 0.867s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:45 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.info is being set with open permissions: ugo+rw
Jun 18 11:32:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:45 devstack sudo[101098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.info
Jun 18 11:32:45 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:45 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.info" returned: 0 in 0.783s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.824s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:46 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-5e7b63db-c8ce-4d98-8e39-659479cd07f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Create snapshot completed successfully
Jun 18 11:32:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Acquiring lock "cinder-c85bd4bc-e86c-43be-8721-e396806420a4-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "cinder-c85bd4bc-e86c-43be-8721-e396806420a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Acquiring lock "cinder-quobyte-70ed244d-19af-48be-bfe7-4771fa27fdd5" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "cinder-quobyte-70ed244d-19af-48be-bfe7-4771fa27fdd5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Acquiring lock "cinder-quobyte-c85bd4bc-e86c-43be-8721-e396806420a4" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "cinder-quobyte-c85bd4bc-e86c-43be-8721-e396806420a4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Deleting offline snapshot c85bd4bc-e86c-43be-8721-e396806420a4 of volume 70ed244d-19af-48be-bfe7-4771fa27fdd5 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:32:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] snapshot_file for this snap is: volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:32:47 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[523cb6f5-b7c4-402c-8359-468b040141ac]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:32:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:47 devstack sudo[101101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4
Jun 18 11:32:47 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4" returned: 0 in 1.217s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:48 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70ed244d-19af-48be-bfe7-4771fa27fdd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:32:48 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aec576-cec1-4eef-a3cf-259fef8aceee]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:32:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:48 devstack sudo[101141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5
Jun 18 11:32:48 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:50 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5" returned: 0 in 1.420s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:50 devstack sudo[101151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4
Jun 18 11:32:50 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:51 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4" returned: 0 in 0.912s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:51 devstack sudo[101157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4
Jun 18 11:32:51 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:51 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5.c85bd4bc-e86c-43be-8721-e396806420a4" returned: 0 in 0.757s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "cinder-quobyte-c85bd4bc-e86c-43be-8721-e396806420a4" released by "_delete_snapshot" :: held 4.476s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:32:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "cinder-quobyte-70ed244d-19af-48be-bfe7-4771fa27fdd5" released by "delete_snapshot" :: held 4.511s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:32:51 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Created reservations ['d172a0ea-3dac-4aab-ad76-39e19d4e994f', 'ecd512c6-3f2b-4312-969a-2acb36fcf78a', '666f04b8-dff7-4d18-93ba-5451d82cc9b7', '003d2fad-40da-4586-9c9d-bf6bbab11321'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:32:51 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Delete snapshot completed successfully.
Jun 18 11:32:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9260034-5756-4867-bbb3-2561efee82f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "cinder-c85bd4bc-e86c-43be-8721-e396806420a4-delete_snapshot" released by "delete_snapshot" :: held 4.673s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:32:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Acquiring lock "cinder-70ed244d-19af-48be-bfe7-4771fa27fdd5-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "cinder-70ed244d-19af-48be-bfe7-4771fa27fdd5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Acquiring lock "cinder-quobyte-70ed244d-19af-48be-bfe7-4771fa27fdd5" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "cinder-quobyte-70ed244d-19af-48be-bfe7-4771fa27fdd5" acquired by "delete_volume" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:52 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ac3514-3970-400b-b7d3-7e3688c9205a]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:32:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:52 devstack sudo[101174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5
Jun 18 11:32:52 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:53 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5" returned: 0 in 0.817s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:53 devstack sudo[101180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5
Jun 18 11:32:53 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:54 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-70ed244d-19af-48be-bfe7-4771fa27fdd5" returned: 0 in 0.786s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "cinder-quobyte-70ed244d-19af-48be-bfe7-4771fa27fdd5" released by "delete_volume" :: held 1.687s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:32:54 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Created reservations ['e98cd6fc-aba3-445b-853a-2fb3b87aad13', '5b20a335-dd90-4f78-a8c1-389e168229a9', '3f0aa8ce-cf33-4864-9bdd-fc79a48693fc', 'f44536ad-a21f-40ce-9029-30270d4179fe'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:32:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:54 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:32:54 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:32:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:54 devstack sudo[101183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:32:54 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:55 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.839s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:55 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:32:55 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Deleted volume successfully.
Jun 18 11:32:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a79070c0-4ee2-4e30-a5c6-76f7e66d4e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-401329383 None] Lock "cinder-70ed244d-19af-48be-bfe7-4771fa27fdd5-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:32:56 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "cinder-cfca698e-d011-4d74-966f-69ef521995d7-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:56 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "cinder-cfca698e-d011-4d74-966f-69ef521995d7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:56 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "cinder-quobyte-cfca698e-d011-4d74-966f-69ef521995d7" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:56 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "cinder-quobyte-cfca698e-d011-4d74-966f-69ef521995d7" acquired by "delete_volume" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:56 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a9309a-0edb-4c0f-8e27-69440e0eb1c8]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:32:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cfca698e-d011-4d74-966f-69ef521995d7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:56 devstack sudo[101186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cfca698e-d011-4d74-966f-69ef521995d7
Jun 18 11:32:56 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:57 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cfca698e-d011-4d74-966f-69ef521995d7" returned: 0 in 1.003s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cfca698e-d011-4d74-966f-69ef521995d7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:57 devstack sudo[101191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cfca698e-d011-4d74-966f-69ef521995d7
Jun 18 11:32:57 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:58 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cfca698e-d011-4d74-966f-69ef521995d7" returned: 0 in 0.786s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "cinder-quobyte-cfca698e-d011-4d74-966f-69ef521995d7" released by "delete_volume" :: held 1.845s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:32:58 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] Created reservations ['94f8a4c6-0109-45cd-a625-42d9ebe0b4b9', 'b630eb3d-5f38-4df4-b953-8445fc20cb33', '2dbb574e-f794-448b-8a93-70c421ab6c72', '0a484334-e051-40eb-89d6-b5ad24aa3362'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:32:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:32:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:32:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:32:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:32:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:32:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:58 devstack sudo[101194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:32:58 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "cinder-b39be54d-93b1-42e1-bd1f-97770cc7d39b-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] Lock "cinder-b39be54d-93b1-42e1-bd1f-97770cc7d39b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "cinder-quobyte-b39be54d-93b1-42e1-bd1f-97770cc7d39b" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:32:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] Lock "cinder-quobyte-b39be54d-93b1-42e1-bd1f-97770cc7d39b" acquired by "delete_volume" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:32:58 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3385245-7c0e-4b85-9044-a405090fed86]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:32:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:59 devstack sudo[101196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b
Jun 18 11:32:59 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:32:59 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.999s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:59 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:32:59 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] Deleted volume successfully.
Jun 18 11:32:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-eb84a5a3-818c-4118-bbd9-3d4da5549148 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "cinder-cfca698e-d011-4d74-966f-69ef521995d7-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:32:59 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root
Jun 18 11:32:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b" returned: 0 in 0.956s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:32:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:32:59 devstack sudo[101204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b
Jun 18 11:32:59 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:00 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b39be54d-93b1-42e1-bd1f-97770cc7d39b" returned: 0 in 0.801s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] Lock "cinder-quobyte-b39be54d-93b1-42e1-bd1f-97770cc7d39b" released by "delete_volume" :: held 1.820s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:33:00 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] Created reservations ['f60c3b64-1bf5-4897-aa38-bbdaf55fcaa1', 'ff5c3c1e-86b3-4729-84c2-179e02e9b6c8', 'f448741e-2590-459c-bf7a-a26db023e230', '3e91eb0d-ef3e-4e55-bd94-04d9b83f1b76'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:33:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:33:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:33:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:00 devstack sudo[101208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:33:00 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:01 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "cinder-a3851e07-d523-44e0-9ea0-e25005e9fa97-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:33:01 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "cinder-a3851e07-d523-44e0-9ea0-e25005e9fa97-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:33:01 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "cinder-quobyte-a3851e07-d523-44e0-9ea0-e25005e9fa97" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:33:01 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "cinder-quobyte-a3851e07-d523-44e0-9ea0-e25005e9fa97" acquired by "delete_volume" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:33:01 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[31526426-1af3-446d-945e-b89cf41ab00f]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:33:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3851e07-d523-44e0-9ea0-e25005e9fa97 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:01 devstack sudo[101211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3851e07-d523-44e0-9ea0-e25005e9fa97
Jun 18 11:33:01 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:01 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.782s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:01 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:33:01 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] Deleted volume successfully.
Jun 18 11:33:01 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2be0e392-f20f-4d8b-9a09-aa5e89ac130c tempest-AttachVolumeNegativeTest-1434192735 None] Lock "cinder-b39be54d-93b1-42e1-bd1f-97770cc7d39b-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:33:02 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3851e07-d523-44e0-9ea0-e25005e9fa97" returned: 0 in 0.940s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3851e07-d523-44e0-9ea0-e25005e9fa97 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:02 devstack sudo[101222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3851e07-d523-44e0-9ea0-e25005e9fa97
Jun 18 11:33:02 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:03 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3851e07-d523-44e0-9ea0-e25005e9fa97" returned: 0 in 0.934s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:03 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "cinder-quobyte-a3851e07-d523-44e0-9ea0-e25005e9fa97" released by "delete_volume" :: held 1.937s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:33:03 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] Created reservations ['9fcbc0b1-6a3d-4ffb-927b-5c03e17ee5bf', 'a39ef997-6ea9-4efb-8071-d15a75a4bbaf', 'ea0223af-3f9c-414e-a0c3-cd157856955e', 'c13ebca3-019d-4655-b99d-f8c9d9f80884'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:33:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:33:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:33:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:03 devstack sudo[101227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:33:03 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:04 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.071s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:04 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:33:04 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] Deleted volume successfully.
Jun 18 11:33:04 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-627a8bc2-2200-49e7-a4b2-7dce2ddcbe57 tempest-AttachVolumeNegativeTest-1434192735 None] Lock "cinder-a3851e07-d523-44e0-9ea0-e25005e9fa97-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:33:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] Acquiring lock "cinder-e7c9a1fd-a050-4e34-85d8-f96e730ef15e-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:33:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] Lock "cinder-e7c9a1fd-a050-4e34-85d8-f96e730ef15e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:33:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] Acquiring lock "cinder-quobyte-e7c9a1fd-a050-4e34-85d8-f96e730ef15e" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:33:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] Lock "cinder-quobyte-e7c9a1fd-a050-4e34-85d8-f96e730ef15e" acquired by "delete_volume" :: waited 0.026s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:33:12 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d213381-816c-4323-a643-9717e8d820e6]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:33:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e7c9a1fd-a050-4e34-85d8-f96e730ef15e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:12 devstack sudo[101316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e7c9a1fd-a050-4e34-85d8-f96e730ef15e
Jun 18 11:33:12 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:33:13 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Flow 'volume_create_manager' (795e7672-38ad-4647-8877-d5483c84e4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77130be-a684-4093-a844-3882a66a8103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e7c9a1fd-a050-4e34-85d8-f96e730ef15e" returned: 0 in 1.098s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e7c9a1fd-a050-4e34-85d8-f96e730ef15e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77130be-a684-4093-a844-3882a66a8103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-471330163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ea2236-253a-4f1d-b44c-2965c5cd232b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b49f342f1bbf4974995d5d9ac2570acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:33:13Z,use_quota=True,user_id='df316f4c199a4b7c847b8f57dfdba9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:13 devstack sudo[101321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e7c9a1fd-a050-4e34-85d8-f96e730ef15e
Jun 18 11:33:13 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf91066e-dc3f-487a-83ff-4e0c456b0ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf91066e-dc3f-487a-83ff-4e0c456b0ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca9b1f4-423c-4f6e-a4cf-a33c933e6a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca9b1f4-423c-4f6e-a4cf-a33c933e6a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ea2236-253a-4f1d-b44c-2965c5cd232b', 'volume_name': 'volume-31ea2236-253a-4f1d-b44c-2965c5cd232b', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d593bc9-8d56-49be-b95c-d083634c1b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d593bc9-8d56-49be-b95c-d083634c1b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7802e9-8ddf-4e0d-806e-3e9fbd7b6b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:13 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Volume 31ea2236-253a-4f1d-b44c-2965c5cd232b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ea2236-253a-4f1d-b44c-2965c5cd232b', 'volume_size': 1}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-471330163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ea2236-253a-4f1d-b44c-2965c5cd232b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b49f342f1bbf4974995d5d9ac2570acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:33:13Z,use_quota=True,user_id='df316f4c199a4b7c847b8f57dfdba9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Creating volume 31ea2236-253a-4f1d-b44c-2965c5cd232b {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:33:13 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:33:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-31ea2236-253a-4f1d-b44c-2965c5cd232b 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:13 devstack sudo[101323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-31ea2236-253a-4f1d-b44c-2965c5cd232b 1073741824
Jun 18 11:33:13 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:14 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e7c9a1fd-a050-4e34-85d8-f96e730ef15e" returned: 0 in 0.833s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] Lock "cinder-quobyte-e7c9a1fd-a050-4e34-85d8-f96e730ef15e" released by "delete_volume" :: held 1.985s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:33:14 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] Created reservations ['238509a8-10df-4fa8-bd48-7e7bc44ea7c3', '8939e6ec-e90b-450a-a760-35ddec0c9ffa', '5827aab5-4c6a-45ef-bc35-a1f085593355', '511c66eb-b674-46ac-b4f7-25e00ea2e3ca'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:33:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:33:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:33:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:14 devstack sudo[101334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:33:14 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:14 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-31ea2236-253a-4f1d-b44c-2965c5cd232b 1073741824" returned: 0 in 1.078s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-31ea2236-253a-4f1d-b44c-2965c5cd232b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:14 devstack sudo[101336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-31ea2236-253a-4f1d-b44c-2965c5cd232b
Jun 18 11:33:14 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:15 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.701s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:15 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:33:15 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] Deleted volume successfully.
Jun 18 11:33:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-67090b67-8d8b-40c6-98d0-7713bcda8c74 tempest-AttachVolumeShelveTestJSON-394038834 None] Lock "cinder-e7c9a1fd-a050-4e34-85d8-f96e730ef15e-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:33:15 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-31ea2236-253a-4f1d-b44c-2965c5cd232b" returned: 0 in 0.905s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] <== create_volume: return (2032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:33:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.035s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7802e9-8ddf-4e0d-806e-3e9fbd7b6b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ea2236-253a-4f1d-b44c-2965c5cd232b', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6187919-ff60-4b1f-8afe-3ce48769455a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:15 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Volume volume-31ea2236-253a-4f1d-b44c-2965c5cd232b (31ea2236-253a-4f1d-b44c-2965c5cd232b): created successfully
Jun 18 11:33:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6187919-ff60-4b1f-8afe-3ce48769455a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Flow 'volume_create_manager' (795e7672-38ad-4647-8877-d5483c84e4b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:33:15 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-3db2554a-5629-45cc-8605-e623b57e8f66 tempest-VolumesTestJSON-900924963 None] Created volume successfully.
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Flow 'volume_create_manager' (96faeb03-009f-4206-8b0c-6acd67219aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1c37dd-528d-4c3c-be18-2c5747506705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1c37dd-528d-4c3c-be18-2c5747506705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1691459821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddcc2530-9d0a-437c-9d92-90404964f795,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b49f342f1bbf4974995d5d9ac2570acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:33:17Z,use_quota=True,user_id='df316f4c199a4b7c847b8f57dfdba9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a881e6c-6f58-469a-b208-69346a49e45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a881e6c-6f58-469a-b208-69346a49e45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1de3214-dfbe-473d-a541-75f0e72d0abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1de3214-dfbe-473d-a541-75f0e72d0abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddcc2530-9d0a-437c-9d92-90404964f795', 'volume_name': 'volume-ddcc2530-9d0a-437c-9d92-90404964f795', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce4d5c4-a995-4155-b668-c3c5b7437b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce4d5c4-a995-4155-b668-c3c5b7437b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e903f967-24b3-487f-89dd-b7cc981fcb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:17 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Volume ddcc2530-9d0a-437c-9d92-90404964f795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddcc2530-9d0a-437c-9d92-90404964f795', 'volume_size': 1}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1691459821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddcc2530-9d0a-437c-9d92-90404964f795,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b49f342f1bbf4974995d5d9ac2570acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:33:17Z,use_quota=True,user_id='df316f4c199a4b7c847b8f57dfdba9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Creating volume ddcc2530-9d0a-437c-9d92-90404964f795 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:33:17 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:33:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ddcc2530-9d0a-437c-9d92-90404964f795 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:17 devstack sudo[101443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ddcc2530-9d0a-437c-9d92-90404964f795 1073741824
Jun 18 11:33:17 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:19 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ddcc2530-9d0a-437c-9d92-90404964f795 1073741824" returned: 0 in 1.767s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ddcc2530-9d0a-437c-9d92-90404964f795 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:19 devstack sudo[101451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ddcc2530-9d0a-437c-9d92-90404964f795
Jun 18 11:33:19 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:20 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ddcc2530-9d0a-437c-9d92-90404964f795" returned: 0 in 0.975s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:20 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] <== create_volume: return (2815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:33:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.818s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e903f967-24b3-487f-89dd-b7cc981fcb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddcc2530-9d0a-437c-9d92-90404964f795', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df25e4a-ec54-4078-bbaa-1147c4f8ed25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:20 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Volume volume-ddcc2530-9d0a-437c-9d92-90404964f795 (ddcc2530-9d0a-437c-9d92-90404964f795): created successfully
Jun 18 11:33:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df25e4a-ec54-4078-bbaa-1147c4f8ed25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Flow 'volume_create_manager' (96faeb03-009f-4206-8b0c-6acd67219aac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:33:20 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-86a4982f-00f0-49fd-a4e0-939b490ba9d1 tempest-VolumesTestJSON-900924963 None] Created volume successfully.
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Flow 'volume_create_manager' (5b3f40f6-3142-4279-863a-23355daf5811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf513f1-4209-41ca-82e8-1d59a8096ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf513f1-4209-41ca-82e8-1d59a8096ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-705392807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af7be28-47d9-403b-9ab0-d0d20a97dd61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b49f342f1bbf4974995d5d9ac2570acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:33:22Z,use_quota=True,user_id='df316f4c199a4b7c847b8f57dfdba9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717bced4-4626-4e5d-96d9-9b285e6c89e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717bced4-4626-4e5d-96d9-9b285e6c89e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd49cec-eef2-4865-aa74-4724acc0bf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd49cec-eef2-4865-aa74-4724acc0bf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af7be28-47d9-403b-9ab0-d0d20a97dd61', 'volume_name': 'volume-8af7be28-47d9-403b-9ab0-d0d20a97dd61', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50afa89-b34b-494a-973c-fda386ed77bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50afa89-b34b-494a-973c-fda386ed77bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718e1626-2c4e-4c24-adee-8ddc8d3fcef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:21 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Volume 8af7be28-47d9-403b-9ab0-d0d20a97dd61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af7be28-47d9-403b-9ab0-d0d20a97dd61', 'volume_size': 1}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-705392807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af7be28-47d9-403b-9ab0-d0d20a97dd61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b49f342f1bbf4974995d5d9ac2570acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:33:22Z,use_quota=True,user_id='df316f4c199a4b7c847b8f57dfdba9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Creating volume 8af7be28-47d9-403b-9ab0-d0d20a97dd61 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:33:21 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:33:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8af7be28-47d9-403b-9ab0-d0d20a97dd61 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:22 devstack sudo[101455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8af7be28-47d9-403b-9ab0-d0d20a97dd61 1073741824
Jun 18 11:33:22 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:23 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8af7be28-47d9-403b-9ab0-d0d20a97dd61 1073741824" returned: 0 in 1.745s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8af7be28-47d9-403b-9ab0-d0d20a97dd61 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:23 devstack sudo[101461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8af7be28-47d9-403b-9ab0-d0d20a97dd61
Jun 18 11:33:23 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:24 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8af7be28-47d9-403b-9ab0-d0d20a97dd61" returned: 0 in 1.150s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:24 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] <== create_volume: return (2989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:33:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.992s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718e1626-2c4e-4c24-adee-8ddc8d3fcef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af7be28-47d9-403b-9ab0-d0d20a97dd61', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e7184e-5db2-4164-aefa-6aee5530d8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:25 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Volume volume-8af7be28-47d9-403b-9ab0-d0d20a97dd61 (8af7be28-47d9-403b-9ab0-d0d20a97dd61): created successfully
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e7184e-5db2-4164-aefa-6aee5530d8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Flow 'volume_create_manager' (5b3f40f6-3142-4279-863a-23355daf5811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:33:25 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-190d159e-87ab-4875-886d-1a695dae8bd1 tempest-VolumesTestJSON-900924963 None] Created volume successfully.
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:25 devstack sudo[101464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:33:25 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Flow 'volume_create_manager' (659db2d1-c137-421a-baab-ca0a0e9fa482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c87737-3449-496c-996a-57a1726df2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c87737-3449-496c-996a-57a1726df2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1001805016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cb7a5f-851c-4728-80b4-877f5d640223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='787bf93266904e089b489d32e9846b48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:33:26Z,use_quota=True,user_id='6b994fefac024a60b4ed7d2e6aa87164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663f495a-6482-4b5f-84e1-50cb7fcd88c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663f495a-6482-4b5f-84e1-50cb7fcd88c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff500240-5e10-4d70-bb03-893d2505b36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff500240-5e10-4d70-bb03-893d2505b36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9cb7a5f-851c-4728-80b4-877f5d640223', 'volume_name': 'volume-e9cb7a5f-851c-4728-80b4-877f5d640223', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77c33e4-86b6-4e96-a08b-50b4f8a59c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77c33e4-86b6-4e96-a08b-50b4f8a59c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08267d0-8c23-454a-8f45-0cb8afd58734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:25 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Volume e9cb7a5f-851c-4728-80b4-877f5d640223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9cb7a5f-851c-4728-80b4-877f5d640223', 'volume_size': 1}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1001805016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cb7a5f-851c-4728-80b4-877f5d640223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='787bf93266904e089b489d32e9846b48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:33:26Z,use_quota=True,user_id='6b994fefac024a60b4ed7d2e6aa87164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Creating volume e9cb7a5f-851c-4728-80b4-877f5d640223 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:33:25 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:33:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e9cb7a5f-851c-4728-80b4-877f5d640223 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:25 devstack sudo[101467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e9cb7a5f-851c-4728-80b4-877f5d640223 1073741824
Jun 18 11:33:25 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:26 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.092s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:33:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:33:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:33:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:33:27 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e9cb7a5f-851c-4728-80b4-877f5d640223 1073741824" returned: 0 in 1.760s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e9cb7a5f-851c-4728-80b4-877f5d640223 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:27 devstack sudo[101474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e9cb7a5f-851c-4728-80b4-877f5d640223
Jun 18 11:33:27 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:28 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] Acquiring lock "cinder-8af7be28-47d9-403b-9ab0-d0d20a97dd61-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:33:28 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] Lock "cinder-8af7be28-47d9-403b-9ab0-d0d20a97dd61-delete_volume" acquired by "delete_volume" :: waited 0.203s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:33:28 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] Acquiring lock "cinder-quobyte-8af7be28-47d9-403b-9ab0-d0d20a97dd61" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:33:28 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] Lock "cinder-quobyte-8af7be28-47d9-403b-9ab0-d0d20a97dd61" acquired by "delete_volume" :: waited 0.029s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:33:28 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ff25d9-c24a-44c6-958c-adda72ec314e]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:33:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8af7be28-47d9-403b-9ab0-d0d20a97dd61 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:28 devstack sudo[101477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8af7be28-47d9-403b-9ab0-d0d20a97dd61
Jun 18 11:33:28 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:28 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e9cb7a5f-851c-4728-80b4-877f5d640223" returned: 0 in 1.323s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] <== create_volume: return (3142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:33:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.148s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08267d0-8c23-454a-8f45-0cb8afd58734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9cb7a5f-851c-4728-80b4-877f5d640223', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79146ed8-6c63-40b7-852a-c3e82d1d2b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:29 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Volume volume-e9cb7a5f-851c-4728-80b4-877f5d640223 (e9cb7a5f-851c-4728-80b4-877f5d640223): created successfully
Jun 18 11:33:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79146ed8-6c63-40b7-852a-c3e82d1d2b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Flow 'volume_create_manager' (659db2d1-c137-421a-baab-ca0a0e9fa482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:33:29 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-a924769e-03fd-4e76-90c5-fb771a3f46c5 tempest-TestMinimumBasicScenario-140211686 None] Created volume successfully.
Jun 18 11:33:29 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8af7be28-47d9-403b-9ab0-d0d20a97dd61" returned: 0 in 1.133s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8af7be28-47d9-403b-9ab0-d0d20a97dd61 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:29 devstack sudo[101500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8af7be28-47d9-403b-9ab0-d0d20a97dd61
Jun 18 11:33:29 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:30 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8af7be28-47d9-403b-9ab0-d0d20a97dd61" returned: 0 in 0.744s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] Lock "cinder-quobyte-8af7be28-47d9-403b-9ab0-d0d20a97dd61" released by "delete_volume" :: held 1.952s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:33:30 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] Created reservations ['3c6086c2-a2db-41b5-83c2-73f3695aa181', '3e9bede6-a4f3-4a4b-a736-80cebbcfd4a0', '3c9ee5f4-fc04-4b56-83e9-b30bd1e8ee2b', 'b55695e4-159d-4265-9d34-84fbb6211214'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:33:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:30 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:33:30 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:33:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:30 devstack sudo[101506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:33:30 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:31 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.770s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:31 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:33:31 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] Deleted volume successfully.
Jun 18 11:33:31 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7bf86b07-48c5-4ed1-93f8-a54750858952 tempest-VolumesTestJSON-900924963 None] Lock "cinder-8af7be28-47d9-403b-9ab0-d0d20a97dd61-delete_volume" released by "delete_volume" :: held 3.051s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:33:31 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] Acquiring lock "cinder-ddcc2530-9d0a-437c-9d92-90404964f795-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:33:31 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] Lock "cinder-ddcc2530-9d0a-437c-9d92-90404964f795-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:33:31 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] Acquiring lock "cinder-quobyte-ddcc2530-9d0a-437c-9d92-90404964f795" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:33:31 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] Lock "cinder-quobyte-ddcc2530-9d0a-437c-9d92-90404964f795" acquired by "delete_volume" :: waited 0.030s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:33:31 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[260e2120-5d92-45de-994e-483371d335a0]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:33:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ddcc2530-9d0a-437c-9d92-90404964f795 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:32 devstack sudo[101509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ddcc2530-9d0a-437c-9d92-90404964f795
Jun 18 11:33:32 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:32 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ddcc2530-9d0a-437c-9d92-90404964f795" returned: 0 in 0.992s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ddcc2530-9d0a-437c-9d92-90404964f795 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:32 devstack sudo[101514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ddcc2530-9d0a-437c-9d92-90404964f795
Jun 18 11:33:32 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-93382e3d-1b62-4a30-8b18-61b2534ff998 req-e43cdd68-8355-42a8-8593-987c06d353c6 tempest-TestMinimumBasicScenario-140211686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-93382e3d-1b62-4a30-8b18-61b2534ff998 req-e43cdd68-8355-42a8-8593-987c06d353c6 tempest-TestMinimumBasicScenario-140211686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:33 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57b4a22-2728-497c-921b-a26124fad473]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:33:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-93382e3d-1b62-4a30-8b18-61b2534ff998 req-e43cdd68-8355-42a8-8593-987c06d353c6 tempest-TestMinimumBasicScenario-140211686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e9cb7a5f-851c-4728-80b4-877f5d640223 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:33 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ddcc2530-9d0a-437c-9d92-90404964f795" returned: 0 in 0.856s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:33 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] Lock "cinder-quobyte-ddcc2530-9d0a-437c-9d92-90404964f795" released by "delete_volume" :: held 1.903s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:33:33 devstack sudo[101525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e9cb7a5f-851c-4728-80b4-877f5d640223
Jun 18 11:33:33 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:33 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] Created reservations ['613cfce8-4aa0-43b7-b3da-43de9aa3142f', '5c9341d6-8144-4437-ba8d-4560ac53e759', 'a3a3bea0-f002-4b16-8381-4aea701467cf', 'a1e3774d-cbdf-4502-b48b-f154dacee34e'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:33:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:33:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:33:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:34 devstack sudo[101527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:33:34 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] Acquiring lock "cinder-31ea2236-253a-4f1d-b44c-2965c5cd232b-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:33:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] Lock "cinder-31ea2236-253a-4f1d-b44c-2965c5cd232b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:33:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] Acquiring lock "cinder-quobyte-31ea2236-253a-4f1d-b44c-2965c5cd232b" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:33:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] Lock "cinder-quobyte-31ea2236-253a-4f1d-b44c-2965c5cd232b" acquired by "delete_volume" :: waited 0.041s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:33:34 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7a1154-8c6e-4978-aa27-bba11f9846b5]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:33:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-31ea2236-253a-4f1d-b44c-2965c5cd232b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:34 devstack sudo[101529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-31ea2236-253a-4f1d-b44c-2965c5cd232b
Jun 18 11:33:34 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:34 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-93382e3d-1b62-4a30-8b18-61b2534ff998 req-e43cdd68-8355-42a8-8593-987c06d353c6 tempest-TestMinimumBasicScenario-140211686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e9cb7a5f-851c-4728-80b4-877f5d640223" returned: 0 in 1.218s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-93382e3d-1b62-4a30-8b18-61b2534ff998 req-e43cdd68-8355-42a8-8593-987c06d353c6 tempest-TestMinimumBasicScenario-140211686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.239s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:34 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-93382e3d-1b62-4a30-8b18-61b2534ff998 req-e43cdd68-8355-42a8-8593-987c06d353c6 tempest-TestMinimumBasicScenario-140211686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-e9cb7a5f-851c-4728-80b4-877f5d640223', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec073b06-645e-4391-a02f-d010ebf01515', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:33:35 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-93382e3d-1b62-4a30-8b18-61b2534ff998 req-e43cdd68-8355-42a8-8593-987c06d353c6 tempest-TestMinimumBasicScenario-140211686 None] attachment_update completed successfully.
Jun 18 11:33:35 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.254s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:35 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:33:35 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] Deleted volume successfully.
Jun 18 11:33:35 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a229ccef-eada-49d6-be72-81615db36b05 tempest-VolumesTestJSON-900924963 None] Lock "cinder-ddcc2530-9d0a-437c-9d92-90404964f795-delete_volume" released by "delete_volume" :: held 3.523s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:33:35 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-31ea2236-253a-4f1d-b44c-2965c5cd232b" returned: 0 in 1.187s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-31ea2236-253a-4f1d-b44c-2965c5cd232b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:35 devstack sudo[101606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-31ea2236-253a-4f1d-b44c-2965c5cd232b
Jun 18 11:33:35 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:36 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-31ea2236-253a-4f1d-b44c-2965c5cd232b" returned: 0 in 0.941s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:36 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] Lock "cinder-quobyte-31ea2236-253a-4f1d-b44c-2965c5cd232b" released by "delete_volume" :: held 2.222s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:33:36 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:UPDATE=80,cinder:SELECT=69,cinder:DELETE=7,cinder:INSERT=17 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:33:36 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] Created reservations ['ccac2631-4e5d-40f9-ab71-470a2582b12f', 'a4f752b0-6118-47ea-ab3e-935833044d25', '8c698e21-0b9d-4cee-bd0e-340c126f6a67', '934e68de-a3a5-4a50-9a4a-f24e4acdc5cc'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:33:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:33:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:33:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:36 devstack sudo[101925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:33:36 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:38 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.294s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:38 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:33:38 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] Deleted volume successfully.
Jun 18 11:33:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96e56858-8b52-44a7-917f-f8261a04dc2a tempest-VolumesTestJSON-900924963 None] Lock "cinder-31ea2236-253a-4f1d-b44c-2965c5cd232b-delete_volume" released by "delete_volume" :: held 3.928s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:33:40 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=59,cinder:INSERT=24,cinder:UPDATE=86,cinder:DELETE=6 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:33:41 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-04f80c46-2d5e-47c0-8536-4ea421daed6e tempest-GroupsV314Test-75514754 None] Group tempest-GroupsV314Test-Group-965444159: creating
Jun 18 11:33:41 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-04f80c46-2d5e-47c0-8536-4ea421daed6e tempest-GroupsV314Test-75514754 None] Group tempest-GroupsV314Test-Group-965444159: created successfully
Jun 18 11:33:41 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-04f80c46-2d5e-47c0-8536-4ea421daed6e tempest-GroupsV314Test-75514754 None] Create group completed successfully.
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Flow 'volume_create_manager' (4e4bc346-8f66-46f9-8a4a-8c07791d3776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b10f9a-96dc-403e-98e5-0646a1e0e895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b10f9a-96dc-403e-98e5-0646a1e0e895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2093945927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a15a30a-b327-494e-8c0f-48d719348aed,host='devstack@QuobyteHD#QuobyteHD',id=35e5b57b-efb6-45bf-b847-5cbdebfdd8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92fca4d92894f9d989d565ea8b657ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:33:44Z,use_quota=True,user_id='18b04e0634ff4baf9ef4c88f38ec0a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e83691d8-88e7-498b-a157-18e6ee516e38),volume_type_id=e83691d8-88e7-498b-a157-18e6ee516e38)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e7abce-3ced-40e6-8d0e-2c1be561eba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e7abce-3ced-40e6-8d0e-2c1be561eba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246901e1-b9a0-4a8e-8acf-bcfab7f47297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246901e1-b9a0-4a8e-8acf-bcfab7f47297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35e5b57b-efb6-45bf-b847-5cbdebfdd8be', 'volume_name': 'volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af45a48-6b4b-4a9f-8e0a-a80f6b902800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af45a48-6b4b-4a9f-8e0a-a80f6b902800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfedb956-2466-4c9b-8e23-f0d9742ad4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:43 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Volume 35e5b57b-efb6-45bf-b847-5cbdebfdd8be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be', 'volume_size': 1}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5a15a30a-b327-494e-8c0f-48d719348aed,created_at=2026-06-18T09:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2093945927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a15a30a-b327-494e-8c0f-48d719348aed,host='devstack@QuobyteHD#QuobyteHD',id=35e5b57b-efb6-45bf-b847-5cbdebfdd8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92fca4d92894f9d989d565ea8b657ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:33:44Z,use_quota=True,user_id='18b04e0634ff4baf9ef4c88f38ec0a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e83691d8-88e7-498b-a157-18e6ee516e38),volume_type_id=e83691d8-88e7-498b-a157-18e6ee516e38)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Creating volume 35e5b57b-efb6-45bf-b847-5cbdebfdd8be {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:33:43 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:33:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:43 devstack sudo[101939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be 1073741824
Jun 18 11:33:43 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:44 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be 1073741824" returned: 0 in 1.037s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:44 devstack sudo[101946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be
Jun 18 11:33:44 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:45 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be" returned: 0 in 1.065s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] <== create_volume: return (2180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:33:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfedb956-2466-4c9b-8e23-f0d9742ad4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6861a6-1666-4d39-bd1d-a309a0ed3eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:46 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Volume volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be (35e5b57b-efb6-45bf-b847-5cbdebfdd8be): created successfully
Jun 18 11:33:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6861a6-1666-4d39-bd1d-a309a0ed3eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Flow 'volume_create_manager' (4e4bc346-8f66-46f9-8a4a-8c07791d3776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:33:46 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d89556fa-c8b0-4757-9ec4-81d6367f4353 tempest-GroupsV314Test-75514754 None] Created volume successfully.
Jun 18 11:33:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:47 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Cloning volume 35e5b57b-efb6-45bf-b847-5cbdebfdd8be to volume bf4ffb31-2eb4-44c4-b129-c5636350c9ca
Jun 18 11:33:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Creating offline snapshot 03877009-60a8-45f2-b56b-786c41d045e8 of volume 35e5b57b-efb6-45bf-b847-5cbdebfdd8be {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:33:48 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[996d32c7-c505-4c26-903d-c2004a8e0624]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:33:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:48 devstack sudo[101960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be
Jun 18 11:33:48 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:48 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-3ad9d65a-b885-4614-bdde-a7b95878d23b tempest-GroupSnapshotsTest-1584421778 None] Group tempest-GroupSnapshotsTest-Group-1704063151: creating
Jun 18 11:33:49 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-3ad9d65a-b885-4614-bdde-a7b95878d23b tempest-GroupSnapshotsTest-1584421778 None] Group tempest-GroupSnapshotsTest-Group-1704063151: created successfully
Jun 18 11:33:49 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-3ad9d65a-b885-4614-bdde-a7b95878d23b tempest-GroupSnapshotsTest-1584421778 None] Create group completed successfully.
Jun 18 11:33:49 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be" returned: 0 in 1.291s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:49 devstack sudo[101988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8 1G
Jun 18 11:33:49 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:50 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8 1G" returned: 0 in 0.990s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:50 devstack sudo[101995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8
Jun 18 11:33:50 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:50 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:33:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Flow 'volume_create_manager' (a1bbc98e-507b-4f35-a2e0-e87652b5a55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:33:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546ba2c0-2a0b-4ee6-83ce-617b970808b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546ba2c0-2a0b-4ee6-83ce-617b970808b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1167437332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=de125687-085f-4448-8c90-6c87b1300389,host='devstack@QuobyteHD#QuobyteHD',id=1c8741e3-c37b-4afb-b6e4-7634633a0453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9957a7edc41b698ae63f06a2a4e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:33:51Z,use_quota=True,user_id='29840517423548ea9a20a8a4f84a5ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03822431-c4c5-4029-9194-46f24f57f816),volume_type_id=03822431-c4c5-4029-9194-46f24f57f816)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96bc02f2-86dd-43db-b7f9-82c8ae4cfa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96bc02f2-86dd-43db-b7f9-82c8ae4cfa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0801dc70-8969-478c-96f9-731b96b6a8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0801dc70-8969-478c-96f9-731b96b6a8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c8741e3-c37b-4afb-b6e4-7634633a0453', 'volume_name': 'volume-1c8741e3-c37b-4afb-b6e4-7634633a0453', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f5187d-423d-42b5-b039-0eefc9b13886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f5187d-423d-42b5-b039-0eefc9b13886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:33:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529e7aeb-13be-48aa-8f83-cba1aa43f923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:33:50 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Volume 1c8741e3-c37b-4afb-b6e4-7634633a0453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c8741e3-c37b-4afb-b6e4-7634633a0453', 'volume_size': 1}
Jun 18 11:33:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:51 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8" returned: 0 in 0.833s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:51 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8 is being set with open permissions: ugo+rw: NotImplementedError
Jun 18 11:33:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:51 devstack sudo[102000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8
Jun 18 11:33:51 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:51 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8" returned: 0 in 0.663s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:52 devstack sudo[102003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.info
Jun 18 11:33:52 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:52 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.info" returned: 0 in 0.671s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:52 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 18 11:33:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:52 devstack sudo[102006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.info
Jun 18 11:33:52 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:53 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.info" returned: 0 in 0.669s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Acquiring lock "cinder-quobyte-bf4ffb31-2eb4-44c4-b129-c5636350c9ca" by "_copy_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:33:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Lock "cinder-quobyte-bf4ffb31-2eb4-44c4-b129-c5636350c9ca" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:33:53 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] snapshot: 03877009-60a8-45f2-b56b-786c41d045e8, volume: bf4ffb31-2eb4-44c4-b129-c5636350c9ca,  {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 18 11:33:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:33:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:33:53 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:33:53 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:33:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:33:53 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[3828a565-2779-4a0c-90be-6311a04d0a85]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:33:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:53 devstack sudo[102012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8
Jun 18 11:33:53 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:54 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8" returned: 0 in 0.769s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:54 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:33:54 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 18 11:33:54 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Creating direct copy from snapshot {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 18 11:33:54 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccc9b87-8619-49d4-b8c4-eb870deb1ee4]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:33:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:54 devstack sudo[102017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be
Jun 18 11:33:54 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:33:55 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root
Jun 18 11:33:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be" returned: 0 in 1.086s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:33:55 devstack cinder-volume[91663]: DEBUG cinder.utils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Path /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bf4ffb31-2eb4-44c4-b129-c5636350c9ca not found in is_blk_device check {{(pid=91663) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 18 11:33:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bf4ffb31-2eb4-44c4-b129-c5636350c9ca {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:33:55 devstack sudo[102077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bf4ffb31-2eb4-44c4-b129-c5636350c9ca
Jun 18 11:33:55 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:00 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:34:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Flow 'volume_create_manager' (b4e1763f-1515-42c2-9391-135cac3695c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:34:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0e5f77-f0f9-4224-915e-34a746b3b967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0e5f77-f0f9-4224-915e-34a746b3b967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1247501398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9507aa98-1011-4d51-9683-a28755d38a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33670cbf3944b52831b6425bbe00c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:34:00Z,use_quota=True,user_id='a795cbbce53d4c87a5442983b809279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dc1e39-4fbf-48af-884b-7aea18c8bef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dc1e39-4fbf-48af-884b-7aea18c8bef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd30ed8a-f698-4fac-bbcf-09838d211b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd30ed8a-f698-4fac-bbcf-09838d211b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9507aa98-1011-4d51-9683-a28755d38a29', 'volume_name': 'volume-9507aa98-1011-4d51-9683-a28755d38a29', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eaed2e3-c2c6-4e24-9289-73058774f93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eaed2e3-c2c6-4e24-9289-73058774f93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836d4438-741a-47db-86a3-d3d3b83ea916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:00 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Volume 9507aa98-1011-4d51-9683-a28755d38a29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9507aa98-1011-4d51-9683-a28755d38a29', 'volume_size': 1}
Jun 18 11:34:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:03 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bf4ffb31-2eb4-44c4-b129-c5636350c9ca" returned: 0 in 7.866s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:03 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f224a5-a1dd-45a4-b763-e1a86aee78af]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:03 devstack sudo[102132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be
Jun 18 11:34:03 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:04 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be" returned: 0 in 1.134s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:04 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be, size 1024.00 MB, duration 7.87 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bf4ffb31-2eb4-44c4-b129-c5636350c9ca {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:34:04 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Converted 1024.00 MB image at 130.16 MB/s
Jun 18 11:34:04 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bf4ffb31-2eb4-44c4-b129-c5636350c9ca is being set with open permissions: ugo+rw: NotImplementedError
Jun 18 11:34:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bf4ffb31-2eb4-44c4-b129-c5636350c9ca {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:04 devstack sudo[102176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bf4ffb31-2eb4-44c4-b129-c5636350c9ca
Jun 18 11:34:04 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:05 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bf4ffb31-2eb4-44c4-b129-c5636350c9ca" returned: 0 in 1.081s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:05 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Lock "cinder-quobyte-bf4ffb31-2eb4-44c4-b129-c5636350c9ca" released by "_copy_volume_from_snapshot" :: held 12.036s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:05 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Acquiring lock "cinder-quobyte-03877009-60a8-45f2-b56b-786c41d045e8" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:05 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Lock "cinder-quobyte-03877009-60a8-45f2-b56b-786c41d045e8" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Deleting offline snapshot 03877009-60a8-45f2-b56b-786c41d045e8 of volume 35e5b57b-efb6-45bf-b847-5cbdebfdd8be {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:34:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] snapshot_file for this snap is: volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:34:05 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8330eab-1259-4447-8fdc-4092cf4eb4ad]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:05 devstack sudo[102239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8
Jun 18 11:34:05 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:06 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8" returned: 0 in 1.359s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:34:06 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[6835d4fe-a97e-4a5b-8e0b-42ad8633da73]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:07 devstack sudo[102262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be
Jun 18 11:34:07 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:08 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be" returned: 0 in 1.168s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:08 devstack sudo[102267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8
Jun 18 11:34:08 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:08 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8" returned: 0 in 0.914s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:09 devstack sudo[102284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8
Jun 18 11:34:09 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:09 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be.03877009-60a8-45f2-b56b-786c41d045e8" returned: 0 in 0.651s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Lock "cinder-quobyte-03877009-60a8-45f2-b56b-786c41d045e8" released by "_delete_snapshot" :: held 4.213s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.793s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.904s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=de125687-085f-4448-8c90-6c87b1300389,created_at=2026-06-18T09:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1167437332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=de125687-085f-4448-8c90-6c87b1300389,host='devstack@QuobyteHD#QuobyteHD',id=1c8741e3-c37b-4afb-b6e4-7634633a0453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9957a7edc41b698ae63f06a2a4e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:33:51Z,use_quota=True,user_id='29840517423548ea9a20a8a4f84a5ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03822431-c4c5-4029-9194-46f24f57f816),volume_type_id=03822431-c4c5-4029-9194-46f24f57f816)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:34:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Creating volume 1c8741e3-c37b-4afb-b6e4-7634633a0453 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:34:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:34:09 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:34:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:09 devstack sudo[102288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 1073741824
Jun 18 11:34:09 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:09 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-2c4575c1-3b89-436a-8876-11c63ccc1bcc tempest-GroupsV314Test-75514754 None] Create group from source-group-5a15a30a-b327-494e-8c0f-48d719348aed completed successfully.
Jun 18 11:34:10 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 1073741824" returned: 0 in 0.865s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:10 devstack sudo[102293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453
Jun 18 11:34:10 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:11 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453" returned: 0 in 0.665s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.623s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1247501398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9507aa98-1011-4d51-9683-a28755d38a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33670cbf3944b52831b6425bbe00c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:34:00Z,use_quota=True,user_id='a795cbbce53d4c87a5442983b809279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Creating volume 9507aa98-1011-4d51-9683-a28755d38a29 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:34:11 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9507aa98-1011-4d51-9683-a28755d38a29 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529e7aeb-13be-48aa-8f83-cba1aa43f923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8741e3-c37b-4afb-b6e4-7634633a0453', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:11 devstack sudo[102296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9507aa98-1011-4d51-9683-a28755d38a29 1073741824
Jun 18 11:34:11 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd445dae-e132-4f8f-9b92-363be11a4a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:11 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Volume volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 (1c8741e3-c37b-4afb-b6e4-7634633a0453): created successfully
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd445dae-e132-4f8f-9b92-363be11a4a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Flow 'volume_create_manager' (a1bbc98e-507b-4f35-a2e0-e87652b5a55d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:34:11 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-95f68cd9-9d31-4930-956b-9e4fc2f8c20a tempest-GroupSnapshotsTest-1584421778 None] Created volume successfully.
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] Acquiring lock "cinder-quobyte-bf4ffb31-2eb4-44c4-b129-c5636350c9ca" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] Lock "cinder-quobyte-bf4ffb31-2eb4-44c4-b129-c5636350c9ca" acquired by "delete_volume" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c28cec-9b0b-4812-bbb9-e5fb47d5e94e]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bf4ffb31-2eb4-44c4-b129-c5636350c9ca {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:11 devstack sudo[102298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bf4ffb31-2eb4-44c4-b129-c5636350c9ca
Jun 18 11:34:11 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:12 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9507aa98-1011-4d51-9683-a28755d38a29 1073741824" returned: 0 in 0.931s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:12 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bf4ffb31-2eb4-44c4-b129-c5636350c9ca" returned: 0 in 0.789s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bf4ffb31-2eb4-44c4-b129-c5636350c9ca {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9507aa98-1011-4d51-9683-a28755d38a29 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:12 devstack sudo[102306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bf4ffb31-2eb4-44c4-b129-c5636350c9ca
Jun 18 11:34:12 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:12 devstack sudo[102307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9507aa98-1011-4d51-9683-a28755d38a29
Jun 18 11:34:12 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:12 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] GroupSnapshot 9b10b224-e8a2-4c6b-9799-cff35ac44b28: creating.
Jun 18 11:34:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] Group snapshot 9b10b224-e8a2-4c6b-9799-cff35ac44b28: creating. {{(pid=91663) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 18 11:34:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:13 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9507aa98-1011-4d51-9683-a28755d38a29" returned: 0 in 0.838s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.298s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:13 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bf4ffb31-2eb4-44c4-b129-c5636350c9ca" returned: 0 in 0.880s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836d4438-741a-47db-86a3-d3d3b83ea916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9507aa98-1011-4d51-9683-a28755d38a29', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76ddd6a-11d2-4b9f-b90b-a0cd45abd21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] Creating offline snapshot 4618510b-aaaa-4a57-831c-6526c09de42e of volume 1c8741e3-c37b-4afb-b6e4-7634633a0453 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] Lock "cinder-quobyte-bf4ffb31-2eb4-44c4-b129-c5636350c9ca" released by "delete_volume" :: held 1.745s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8dc5f6-787a-493a-96a9-55121717265b]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:13 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Volume volume-9507aa98-1011-4d51-9683-a28755d38a29 (9507aa98-1011-4d51-9683-a28755d38a29): created successfully
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76ddd6a-11d2-4b9f-b90b-a0cd45abd21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Flow 'volume_create_manager' (b4e1763f-1515-42c2-9391-135cac3695c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:34:13 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-f1c2a204-0453-4aff-99ae-c64c16445a2e tempest-VolumesActionsTest-1234935443 None] Created volume successfully.
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] Created reservations ['cb226c4a-fc04-4a61-816f-91f7ad2ce878'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:34:13 devstack cinder-volume[91663]: WARNING cinder.quota [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1103432078 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1103432078, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:34:13 devstack cinder-volume[91663]: WARNING cinder.quota [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1103432078 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1103432078, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:34:13 devstack sudo[102312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] Created reservations ['f87fd927-3ab5-40be-937a-56d9fb8adaf0', '505528d8-1fae-4cbc-8989-d40f0a488186', 'e61e0c3a-6602-44b3-a475-9154fcf3d50b', '48da86a1-a1e9-4656-9590-02a668fc83f7'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:34:13 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:13 devstack sudo[102314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:34:13 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3cfca77d-8823-4013-b906-46f646f4def6 tempest-VolumesActionsTest-1234935443 None] Acquiring lock "cinder-9507aa98-1011-4d51-9683-a28755d38a29" by "attach_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3cfca77d-8823-4013-b906-46f646f4def6 tempest-VolumesActionsTest-1234935443 None] Lock "cinder-9507aa98-1011-4d51-9683-a28755d38a29" acquired by "attach_volume" :: waited 0.032s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:14 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453" returned: 0 in 0.862s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:14 devstack sudo[102319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e 1G
Jun 18 11:34:14 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:14 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-3cfca77d-8823-4013-b906-46f646f4def6 tempest-VolumesActionsTest-1234935443 None] Attaching volume 9507aa98-1011-4d51-9683-a28755d38a29 to instance d9244c26-41e7-4f98-b8b7-b9423edd6ab0 at mountpoint /dev/vdb on host None.
Jun 18 11:34:14 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-3cfca77d-8823-4013-b906-46f646f4def6 tempest-VolumesActionsTest-1234935443 None] Attach volume completed successfully.
Jun 18 11:34:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3cfca77d-8823-4013-b906-46f646f4def6 tempest-VolumesActionsTest-1234935443 None] Lock "cinder-9507aa98-1011-4d51-9683-a28755d38a29" released by "attach_volume" :: held 0.193s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:14 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.874s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:14 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:34:14 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-05614ed1-fd1d-46e8-b1c2-728e869febbe tempest-GroupsV314Test-75514754 None] Delete group completed successfully.
Jun 18 11:34:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] Acquiring lock "cinder-quobyte-35e5b57b-efb6-45bf-b847-5cbdebfdd8be" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] Lock "cinder-quobyte-35e5b57b-efb6-45bf-b847-5cbdebfdd8be" acquired by "delete_volume" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:14 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e41e04f-3b23-4f1a-a9ea-f97822b528fe]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:14 devstack sudo[102322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be
Jun 18 11:34:14 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:15 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e 1G" returned: 0 in 0.991s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:15 devstack sudo[102328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e
Jun 18 11:34:15 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:15 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-8c91d9f6-6281-463c-8351-389ac346b2bf tempest-VolumesActionsTest-537420732 None] Terminate volume connection completed successfully.
Jun 18 11:34:15 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be" returned: 0 in 0.916s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:15 devstack sudo[102333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be
Jun 18 11:34:15 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8c91d9f6-6281-463c-8351-389ac346b2bf tempest-VolumesActionsTest-537420732 None] Acquiring lock "cinder-9507aa98-1011-4d51-9683-a28755d38a29-detach_volume" by "detach_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8c91d9f6-6281-463c-8351-389ac346b2bf tempest-VolumesActionsTest-537420732 None] Lock "cinder-9507aa98-1011-4d51-9683-a28755d38a29-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:15 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-8c91d9f6-6281-463c-8351-389ac346b2bf tempest-VolumesActionsTest-537420732 None] Detaching volume 9507aa98-1011-4d51-9683-a28755d38a29 from instance d9244c26-41e7-4f98-b8b7-b9423edd6ab0.
Jun 18 11:34:15 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-8c91d9f6-6281-463c-8351-389ac346b2bf tempest-VolumesActionsTest-537420732 None] Detach volume completed successfully.
Jun 18 11:34:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8c91d9f6-6281-463c-8351-389ac346b2bf tempest-VolumesActionsTest-537420732 None] Lock "cinder-9507aa98-1011-4d51-9683-a28755d38a29-detach_volume" released by "detach_volume" :: held 0.164s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:16 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e" returned: 0 in 1.019s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:16 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e is being set with open permissions: ugo+rw: NotImplementedError
Jun 18 11:34:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:16 devstack sudo[102338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e
Jun 18 11:34:16 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:16 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35e5b57b-efb6-45bf-b847-5cbdebfdd8be" returned: 0 in 0.907s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] Lock "cinder-quobyte-35e5b57b-efb6-45bf-b847-5cbdebfdd8be" released by "delete_volume" :: held 1.908s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:16 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] Created reservations ['0b47ef75-fc55-4d62-9b8e-4c15658ce0b0'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:34:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4ecd05c3-7189-4b3c-bcdc-542e7038bf80 tempest-VolumesActionsTest-1234935443 None] Acquiring lock "cinder-9507aa98-1011-4d51-9683-a28755d38a29-detach_volume" by "detach_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4ecd05c3-7189-4b3c-bcdc-542e7038bf80 tempest-VolumesActionsTest-1234935443 None] Lock "cinder-9507aa98-1011-4d51-9683-a28755d38a29-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:16 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-4ecd05c3-7189-4b3c-bcdc-542e7038bf80 tempest-VolumesActionsTest-1234935443 None] Volume detach called, but volume not attached.
Jun 18 11:34:16 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] Created reservations ['0de18959-3416-4ddb-9e51-8d9c25be579f', 'fad47acc-4179-418d-a20a-83563dae572a', 'ac2aefb1-c1e8-4d15-9a98-d125e387801c', 'c04563ce-a0f9-4fc6-a23a-805bd560737d'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:34:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4ecd05c3-7189-4b3c-bcdc-542e7038bf80 tempest-VolumesActionsTest-1234935443 None] Lock "cinder-9507aa98-1011-4d51-9683-a28755d38a29-detach_volume" released by "detach_volume" :: held 0.043s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:16 devstack sudo[102341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:34:16 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:17 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e" returned: 0 in 0.939s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:17 devstack sudo[102344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.info
Jun 18 11:34:17 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] Acquiring lock "cinder-9507aa98-1011-4d51-9683-a28755d38a29-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] Lock "cinder-9507aa98-1011-4d51-9683-a28755d38a29-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] Acquiring lock "cinder-quobyte-9507aa98-1011-4d51-9683-a28755d38a29" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] Lock "cinder-quobyte-9507aa98-1011-4d51-9683-a28755d38a29" acquired by "delete_volume" :: waited 0.072s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:17 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f3121a-777a-4e5d-9cf4-1740ceacb845]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9507aa98-1011-4d51-9683-a28755d38a29 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:18 devstack sudo[102380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9507aa98-1011-4d51-9683-a28755d38a29
Jun 18 11:34:18 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:18 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.info" returned: 0 in 1.294s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:18 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 18 11:34:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:18 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.659s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:18 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:34:18 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d8f55506-f1e9-467c-a63f-e6eaa34c282d tempest-GroupsV314Test-75514754 None] Delete group completed successfully.
Jun 18 11:34:18 devstack sudo[102386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.info
Jun 18 11:34:18 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:19 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9507aa98-1011-4d51-9683-a28755d38a29" returned: 0 in 1.316s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9507aa98-1011-4d51-9683-a28755d38a29 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:19 devstack sudo[102391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9507aa98-1011-4d51-9683-a28755d38a29
Jun 18 11:34:19 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:19 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.info" returned: 0 in 0.870s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.165s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:19 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-b8e1e414-867a-4a1b-9d48-8eadcfed4e09 tempest-GroupSnapshotsTest-1584421778 None] group_snapshot 9b10b224-e8a2-4c6b-9799-cff35ac44b28: created successfully
Jun 18 11:34:19 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9507aa98-1011-4d51-9683-a28755d38a29" returned: 0 in 0.906s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] Lock "cinder-quobyte-9507aa98-1011-4d51-9683-a28755d38a29" released by "delete_volume" :: held 2.350s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:20 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] Created reservations ['f4af246d-2288-4c41-9b35-be1544627c02', '0bd61849-1ec7-46b1-8ffa-9bd4335f42ec', 'e9c01ae9-256d-4301-89b7-39b72771de93', '19480578-07c3-4d7e-92ba-caf16e15b781'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:34:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:20 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:20 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:20 devstack sudo[102398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:34:20 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:20 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.738s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:20 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:34:20 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] Deleted volume successfully.
Jun 18 11:34:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-79bc3621-0d69-40a2-aa55-7f5fe3860863 tempest-VolumesActionsTest-1234935443 None] Lock "cinder-9507aa98-1011-4d51-9683-a28755d38a29-delete_volume" released by "delete_volume" :: held 3.541s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "cinder-quobyte-4618510b-aaaa-4a57-831c-6526c09de42e-539fa71c-2c92-4e6d-bcfc-1c816e821962" by "_create_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-4618510b-aaaa-4a57-831c-6526c09de42e-539fa71c-2c92-4e6d-bcfc-1c816e821962" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Creating volume 539fa71c-2c92-4e6d-bcfc-1c816e821962 from snapshot 4618510b-aaaa-4a57-831c-6526c09de42e {{(pid=91663) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "cinder-quobyte-539fa71c-2c92-4e6d-bcfc-1c816e821962" by "_copy_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-539fa71c-2c92-4e6d-bcfc-1c816e821962" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] snapshot: 4618510b-aaaa-4a57-831c-6526c09de42e, volume: 539fa71c-2c92-4e6d-bcfc-1c816e821962,  {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[3655943d-a4db-4796-bc55-c74503b34887]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:21 devstack sudo[102401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e
Jun 18 11:34:21 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:22 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e" returned: 0 in 0.976s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c8741e3-c37b-4afb-b6e4-7634633a0453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:34:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 18 11:34:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Creating direct copy from snapshot {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 18 11:34:22 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f4cb8e-81c0-4824-acb9-8f80967cc749]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:22 devstack sudo[102444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453
Jun 18 11:34:22 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:23 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453" returned: 0 in 0.888s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:23 devstack cinder-volume[91663]: DEBUG cinder.utils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Path /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-539fa71c-2c92-4e6d-bcfc-1c816e821962 not found in is_blk_device check {{(pid=91663) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 18 11:34:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-539fa71c-2c92-4e6d-bcfc-1c816e821962 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:23 devstack sudo[102452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-539fa71c-2c92-4e6d-bcfc-1c816e821962
Jun 18 11:34:23 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:24 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:34:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Flow 'volume_create_manager' (17b1055e-073c-4437-bd77-f58688c822bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:34:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b216e000-f89a-4c4d-bb88-1f51dd0a2748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b216e000-f89a-4c4d-bb88-1f51dd0a2748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1772426679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0376c92-75ab-4049-a1b9-f7d94e016bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0670abd9f944feeb76ef0fc2c734bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:34:24Z,use_quota=True,user_id='aab23104a25544fc944c9b792d2fd18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747c1dec-06eb-4ccc-8c04-d6279c3a6022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747c1dec-06eb-4ccc-8c04-d6279c3a6022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a80652-7b26-4118-a6e3-63c4d71b91dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a80652-7b26-4118-a6e3-63c4d71b91dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0376c92-75ab-4049-a1b9-f7d94e016bd6', 'volume_name': 'volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fbccb59-b8f0-4cdc-a81e-ef76f3a337ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fbccb59-b8f0-4cdc-a81e-ef76f3a337ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed057d6-f0f4-4af4-b375-b3f0aef53b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:24 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Volume b0376c92-75ab-4049-a1b9-f7d94e016bd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6', 'volume_size': 1}
Jun 18 11:34:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:34:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:25 devstack sudo[102466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:34:25 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:27 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 2.127s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:27 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:34:27 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:34:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:34:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:34:29 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-539fa71c-2c92-4e6d-bcfc-1c816e821962" returned: 0 in 6.166s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:29 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e8b3d0-93e4-4a7b-bb33-e288f44ee3c4]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:30 devstack sudo[102475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453
Jun 18 11:34:30 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:30 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:34:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Flow 'volume_create_manager' (8c029d55-e295-45f9-bea3-968843267d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:34:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ed8873-1019-4e14-b015-47813eee8bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ed8873-1019-4e14-b015-47813eee8bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1067668440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532371b0-b4cc-48cc-bf9b-2d2dff25cc86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33670cbf3944b52831b6425bbe00c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:34:30Z,use_quota=True,user_id='a795cbbce53d4c87a5442983b809279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f151d870-1230-46b4-8a34-894534581d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f151d870-1230-46b4-8a34-894534581d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5a8702-cfc2-4e95-bb42-f5dab05cea97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5a8702-cfc2-4e95-bb42-f5dab05cea97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '532371b0-b4cc-48cc-bf9b-2d2dff25cc86', 'volume_name': 'volume-532371b0-b4cc-48cc-bf9b-2d2dff25cc86', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec0ff6c-3c23-452c-9ebc-9302f6729239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec0ff6c-3c23-452c-9ebc-9302f6729239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde7af2e-3612-4ecb-a43b-5d98e1d29f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:30 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Volume 532371b0-b4cc-48cc-bf9b-2d2dff25cc86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-532371b0-b4cc-48cc-bf9b-2d2dff25cc86', 'volume_size': 1}
Jun 18 11:34:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:30 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453" returned: 0 in 1.044s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:30 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-539fa71c-2c92-4e6d-bcfc-1c816e821962 {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:34:30 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Converted 1024.00 MB image at 166.01 MB/s
Jun 18 11:34:30 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-539fa71c-2c92-4e6d-bcfc-1c816e821962 is being set with open permissions: ugo+rw: NotImplementedError
Jun 18 11:34:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-539fa71c-2c92-4e6d-bcfc-1c816e821962 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:30 devstack sudo[102480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-539fa71c-2c92-4e6d-bcfc-1c816e821962
Jun 18 11:34:30 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:31 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-539fa71c-2c92-4e6d-bcfc-1c816e821962" returned: 0 in 0.678s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:31 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-539fa71c-2c92-4e6d-bcfc-1c816e821962" released by "_copy_volume_from_snapshot" :: held 9.866s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:31 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-4618510b-aaaa-4a57-831c-6526c09de42e-539fa71c-2c92-4e6d-bcfc-1c816e821962" released by "_create_volume_from_snapshot" :: held 9.906s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.932s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.980s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:31 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1772426679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0376c92-75ab-4049-a1b9-f7d94e016bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0670abd9f944feeb76ef0fc2c734bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:34:24Z,use_quota=True,user_id='aab23104a25544fc944c9b792d2fd18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:34:31 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Creating volume b0376c92-75ab-4049-a1b9-f7d94e016bd6 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:34:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:31 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:31 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:31 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:34:31 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:34:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:31 devstack sudo[102485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6 1073741824
Jun 18 11:34:31 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:31 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-3bb6b595-d69d-4656-bacc-ae297a27e734 tempest-GroupSnapshotsTest-1584421778 None] Create group from source-snapshot-9b10b224-e8a2-4c6b-9799-cff35ac44b28 completed successfully.
Jun 18 11:34:32 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6 1073741824" returned: 0 in 0.950s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:32 devstack sudo[102494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6
Jun 18 11:34:32 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:32 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-473f793b-92f2-4f98-b6c7-bf00220ca7a7 req-c9366bdb-087e-453f-a478-b1b58b12ec50 tempest-TestMinimumBasicScenario-140211686 None] Terminate volume connection completed successfully.
Jun 18 11:34:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-473f793b-92f2-4f98-b6c7-bf00220ca7a7 req-c9366bdb-087e-453f-a478-b1b58b12ec50 tempest-TestMinimumBasicScenario-140211686 None] Deleting attachment ec073b06-645e-4391-a02f-d010ebf01515. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:34:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "cinder-quobyte-539fa71c-2c92-4e6d-bcfc-1c816e821962" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-539fa71c-2c92-4e6d-bcfc-1c816e821962" acquired by "delete_volume" :: waited 0.018s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:32 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e61328c-7fda-485e-a44e-c50803067c3b]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-539fa71c-2c92-4e6d-bcfc-1c816e821962 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:33 devstack sudo[102496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-539fa71c-2c92-4e6d-bcfc-1c816e821962
Jun 18 11:34:33 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:33 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6" returned: 0 in 0.706s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.063s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1067668440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532371b0-b4cc-48cc-bf9b-2d2dff25cc86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33670cbf3944b52831b6425bbe00c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:34:30Z,use_quota=True,user_id='a795cbbce53d4c87a5442983b809279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Creating volume 532371b0-b4cc-48cc-bf9b-2d2dff25cc86 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:34:33 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-532371b0-b4cc-48cc-bf9b-2d2dff25cc86 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed057d6-f0f4-4af4-b375-b3f0aef53b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea141b3a-ad77-429c-a9f5-d900d8d2cb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:33 devstack sudo[102499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-532371b0-b4cc-48cc-bf9b-2d2dff25cc86 1073741824
Jun 18 11:34:33 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:33 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Volume volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6 (b0376c92-75ab-4049-a1b9-f7d94e016bd6): created successfully
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea141b3a-ad77-429c-a9f5-d900d8d2cb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Flow 'volume_create_manager' (17b1055e-073c-4437-bd77-f58688c822bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:34:33 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-89d39491-a1ae-4176-80cc-46a5661d1aec tempest-SnapshotsActionsTest-171500394 None] Created volume successfully.
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:33 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-539fa71c-2c92-4e6d-bcfc-1c816e821962" returned: 0 in 0.851s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-539fa71c-2c92-4e6d-bcfc-1c816e821962 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:33 devstack sudo[102505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-539fa71c-2c92-4e6d-bcfc-1c816e821962
Jun 18 11:34:33 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:34 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-532371b0-b4cc-48cc-bf9b-2d2dff25cc86 1073741824" returned: 0 in 0.833s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-532371b0-b4cc-48cc-bf9b-2d2dff25cc86 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:34 devstack sudo[102510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-532371b0-b4cc-48cc-bf9b-2d2dff25cc86
Jun 18 11:34:34 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:34 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-539fa71c-2c92-4e6d-bcfc-1c816e821962" returned: 0 in 0.664s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-539fa71c-2c92-4e6d-bcfc-1c816e821962" released by "delete_volume" :: held 1.561s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] Created reservations ['90e28177-a9c7-485c-9752-dec77167bb50'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:34:34 devstack cinder-volume[91663]: WARNING cinder.quota [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1352010443 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1352010443, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:34:34 devstack cinder-volume[91663]: WARNING cinder.quota [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1352010443 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1352010443, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] Created reservations ['a198b625-5633-4a6e-a8fd-51040a153178', '02331c9a-8654-48dd-b427-c30a021e3269', '6ebead8f-86ac-43f4-abf4-3534fdc80639', '34dd98f0-47bc-46cc-83de-793354796d72'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:34 devstack sudo[102513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:34:34 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] Acquiring lock "cinder-e9cb7a5f-851c-4728-80b4-877f5d640223-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] Lock "cinder-e9cb7a5f-851c-4728-80b4-877f5d640223-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] Acquiring lock "cinder-quobyte-e9cb7a5f-851c-4728-80b4-877f5d640223" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] Lock "cinder-quobyte-e9cb7a5f-851c-4728-80b4-877f5d640223" acquired by "delete_volume" :: waited 0.026s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c10a3a-7fd6-4168-9d04-1614649ac2e9]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e9cb7a5f-851c-4728-80b4-877f5d640223 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:34 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-532371b0-b4cc-48cc-bf9b-2d2dff25cc86" returned: 0 in 0.709s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.125s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde7af2e-3612-4ecb-a43b-5d98e1d29f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-532371b0-b4cc-48cc-bf9b-2d2dff25cc86', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1fbe94-52f5-4744-8229-099694f2edf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:34 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] Creating offline snapshot 12ce6b26-cae6-499b-8838-d25b938f52d1 of volume b0376c92-75ab-4049-a1b9-f7d94e016bd6 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:34:34 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Volume volume-532371b0-b4cc-48cc-bf9b-2d2dff25cc86 (532371b0-b4cc-48cc-bf9b-2d2dff25cc86): created successfully
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1fbe94-52f5-4744-8229-099694f2edf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Flow 'volume_create_manager' (8c029d55-e295-45f9-bea3-968843267d1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd7be42-e94c-417a-8b86-5ddaf5370d5e]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:35 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-bd9a32c7-c076-432e-b4ab-fab912d75c5b tempest-VolumesActionsTest-1234935443 None] Created volume successfully.
Jun 18 11:34:35 devstack sudo[102516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e9cb7a5f-851c-4728-80b4-877f5d640223
Jun 18 11:34:35 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:35 devstack sudo[102517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6
Jun 18 11:34:35 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:35 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.737s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:34:35 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-79a725a5-01e4-4913-8f58-b707c337e59f tempest-GroupSnapshotsTest-1584421778 None] Delete group completed successfully.
Jun 18 11:34:35 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] group_snapshot 9b10b224-e8a2-4c6b-9799-cff35ac44b28: deleting
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] group_snapshot 9b10b224-e8a2-4c6b-9799-cff35ac44b28: deleting {{(pid=91663) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "cinder-quobyte-1c8741e3-c37b-4afb-b6e4-7634633a0453" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-1c8741e3-c37b-4afb-b6e4-7634633a0453" acquired by "delete_snapshot" :: waited 0.026s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "cinder-quobyte-4618510b-aaaa-4a57-831c-6526c09de42e" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-4618510b-aaaa-4a57-831c-6526c09de42e" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] Deleting offline snapshot 4618510b-aaaa-4a57-831c-6526c09de42e of volume 1c8741e3-c37b-4afb-b6e4-7634633a0453 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] snapshot_file for this snap is: volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[930d46a6-b8a8-4713-a7d2-e01f9387bc5f]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] Acquiring lock "cinder-532371b0-b4cc-48cc-bf9b-2d2dff25cc86-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] Lock "cinder-532371b0-b4cc-48cc-bf9b-2d2dff25cc86-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:35 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e9cb7a5f-851c-4728-80b4-877f5d640223" returned: 0 in 0.909s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e9cb7a5f-851c-4728-80b4-877f5d640223 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] Acquiring lock "cinder-quobyte-532371b0-b4cc-48cc-bf9b-2d2dff25cc86" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] Lock "cinder-quobyte-532371b0-b4cc-48cc-bf9b-2d2dff25cc86" acquired by "delete_volume" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:35 devstack sudo[102525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e9cb7a5f-851c-4728-80b4-877f5d640223
Jun 18 11:34:35 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:35 devstack sudo[102524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e
Jun 18 11:34:35 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6e1e5e-ead8-4e5f-a069-b7d316335d6f]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-532371b0-b4cc-48cc-bf9b-2d2dff25cc86 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:36 devstack sudo[102531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-532371b0-b4cc-48cc-bf9b-2d2dff25cc86
Jun 18 11:34:36 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:36 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6" returned: 0 in 1.091s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:36 devstack sudo[102533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 1G
Jun 18 11:34:36 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:36 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e9cb7a5f-851c-4728-80b4-877f5d640223" returned: 0 in 0.741s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] Lock "cinder-quobyte-e9cb7a5f-851c-4728-80b4-877f5d640223" released by "delete_volume" :: held 1.702s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:UPDATE=68,cinder:SELECT=83,cinder:INSERT=16,cinder:DELETE=5 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] Created reservations ['85c545ea-e11f-4226-b796-0d593b5fb37d', '4e0614f6-c206-4634-b5d6-1681b4452762', '54af9350-7146-4388-9bb5-bd45bdf90300', '46057624-058a-4ec5-9a2d-721e42a85d42'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:34:36 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e" returned: 0 in 0.997s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c8741e3-c37b-4afb-b6e4-7634633a0453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[3485a110-5eed-47ca-b1ed-1bbfac4e3a2f]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:36 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-532371b0-b4cc-48cc-bf9b-2d2dff25cc86" returned: 0 in 0.869s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-532371b0-b4cc-48cc-bf9b-2d2dff25cc86 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:36 devstack sudo[102547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:34:36 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:36 devstack sudo[102549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-532371b0-b4cc-48cc-bf9b-2d2dff25cc86
Jun 18 11:34:36 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:36 devstack sudo[102544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453
Jun 18 11:34:36 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:37 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 1G" returned: 0 in 1.136s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:37 devstack sudo[102553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1
Jun 18 11:34:37 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:37 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-532371b0-b4cc-48cc-bf9b-2d2dff25cc86" returned: 0 in 0.859s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] Lock "cinder-quobyte-532371b0-b4cc-48cc-bf9b-2d2dff25cc86" released by "delete_volume" :: held 1.816s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:37 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.927s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:37 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:34:37 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] Deleted volume successfully.
Jun 18 11:34:37 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5c3e0c3a-5654-4a16-ad30-22ac989dfb94 tempest-TestMinimumBasicScenario-140211686 None] Lock "cinder-e9cb7a5f-851c-4728-80b4-877f5d640223-delete_volume" released by "delete_volume" :: held 2.949s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453" returned: 0 in 1.061s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:37 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] Created reservations ['e011b84a-eaf2-49be-b71d-0dc1b78d687f', '5869bfce-fea5-4ecd-872d-60a2a9eb8ef3', 'f3449f3e-97eb-4a31-9071-11ca9c96faee', 'db4b48e4-d95e-4387-b266-f3df44574122'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:34:37 devstack sudo[102560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e
Jun 18 11:34:37 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:37 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:37 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:37 devstack sudo[102562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:34:37 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:38 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1" returned: 0 in 0.888s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:38 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 is being set with open permissions: ugo+rw
Jun 18 11:34:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:38 devstack sudo[102567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1
Jun 18 11:34:38 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:38 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:34:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Flow 'volume_create_manager' (38e66c93-782d-40d8-b147-9179be623c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:34:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622b7152-7747-43f4-9442-5e9b003e19c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622b7152-7747-43f4-9442-5e9b003e19c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-706328242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=672a6c64-4032-4a4c-9a46-1dfa7cb2e94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33670cbf3944b52831b6425bbe00c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:34:39Z,use_quota=True,user_id='a795cbbce53d4c87a5442983b809279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:38 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865b64b5-12d0-4871-9ac5-ffbd48c4000f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865b64b5-12d0-4871-9ac5-ffbd48c4000f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e4befd-7c27-4956-926c-7b0923b2058e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e4befd-7c27-4956-926c-7b0923b2058e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '672a6c64-4032-4a4c-9a46-1dfa7cb2e94a', 'volume_name': 'volume-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5709268c-2aae-44d3-936e-ce4c2d10cf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5709268c-2aae-44d3-936e-ce4c2d10cf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00dba3f0-2ce8-4477-96a6-94212edc7027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:39 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Volume 672a6c64-4032-4a4c-9a46-1dfa7cb2e94a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a', 'volume_size': 1}
Jun 18 11:34:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.131s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:39 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:34:39 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] Deleted volume successfully.
Jun 18 11:34:39 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:39 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b751c4c9-9731-4021-8387-83f63f977d1f tempest-VolumesActionsTest-537420732 None] Lock "cinder-532371b0-b4cc-48cc-bf9b-2d2dff25cc86-delete_volume" released by "delete_volume" :: held 3.286s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e" returned: 0 in 1.277s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:39 devstack sudo[102606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e
Jun 18 11:34:39 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:39 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1" returned: 0 in 1.163s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:39 devstack sudo[102609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.info
Jun 18 11:34:39 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:39 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453.4618510b-aaaa-4a57-831c-6526c09de42e" returned: 0 in 0.754s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:39 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-4618510b-aaaa-4a57-831c-6526c09de42e" released by "_delete_snapshot" :: held 4.199s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:39 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-1c8741e3-c37b-4afb-b6e4-7634633a0453" released by "delete_snapshot" :: held 4.239s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:39 devstack cinder-volume[91663]: WARNING cinder.quota [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1352010443 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1352010443, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:34:39 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] Created reservations ['1d956f7c-fe62-44f0-afec-526c90393408', 'cd998ad4-4628-4768-9be1-709f715bb09f', '154df600-83c2-4b0d-8426-469854185a99', '9179ec70-ac37-49a0-bf1f-d7b9c1835422'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:34:39 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-14ca1b69-57ed-414b-8e8b-95e66949a45b tempest-GroupSnapshotsTest-1584421778 None] group_snapshot 9b10b224-e8a2-4c6b-9799-cff35ac44b28: deleted successfully
Jun 18 11:34:40 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.info" returned: 0 in 0.708s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:40 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.info is being set with open permissions: ugo+rw
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:40 devstack sudo[102616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.info
Jun 18 11:34:40 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "cinder-quobyte-1c8741e3-c37b-4afb-b6e4-7634633a0453" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-1c8741e3-c37b-4afb-b6e4-7634633a0453" acquired by "delete_volume" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[4306d168-64d7-4000-a729-ab806ce62e4c]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:40 devstack sudo[102619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453
Jun 18 11:34:40 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:40 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.info" returned: 0 in 0.749s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.855s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.805s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-706328242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=672a6c64-4032-4a4c-9a46-1dfa7cb2e94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33670cbf3944b52831b6425bbe00c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:34:39Z,use_quota=True,user_id='a795cbbce53d4c87a5442983b809279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Creating volume 672a6c64-4032-4a4c-9a46-1dfa7cb2e94a {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:34:40 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:40 devstack sudo[102622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a 1073741824
Jun 18 11:34:40 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:40 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=89,cinder:UPDATE=104,cinder:DELETE=1,cinder:INSERT=18 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:34:40 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-fa2f021f-b6b1-4079-a99f-a207cd49a4f0 tempest-SnapshotsActionsTest-171500394 None] Create snapshot completed successfully
Jun 18 11:34:41 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453" returned: 0 in 0.821s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:41 devstack sudo[102627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453
Jun 18 11:34:41 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-934b5b7c-64cc-4f2a-8437-a7319ef50fa6 tempest-SnapshotsActionsTest-171500394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:41 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a 1073741824" returned: 0 in 0.974s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:41 devstack sudo[102633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a
Jun 18 11:34:41 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:42 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1c8741e3-c37b-4afb-b6e4-7634633a0453" returned: 0 in 0.743s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-1c8741e3-c37b-4afb-b6e4-7634633a0453" released by "delete_volume" :: held 1.636s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] Created reservations ['38d4f5de-1c29-43f8-9cc9-05daef1a750b'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:34:42 devstack cinder-volume[91663]: WARNING cinder.db.api [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1352010443']
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] Created reservations ['c82ca499-eb66-4555-bbe1-897940df73eb', 'c7523576-29e4-4e06-a14c-ad67c48b0efc', 'da41faf4-5629-47b1-8bdc-48e615317e5b', 'bdadcc33-f680-4bed-b3b8-104027c5ce98'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:42 devstack sudo[102636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:34:42 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:42 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a" returned: 0 in 0.660s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-934b5b7c-64cc-4f2a-8437-a7319ef50fa6 tempest-SnapshotsActionsTest-171500394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.796s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00dba3f0-2ce8-4477-96a6-94212edc7027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6de6dba-0ab6-4e54-9946-0dd651cfefd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-934b5b7c-64cc-4f2a-8437-a7319ef50fa6 tempest-SnapshotsActionsTest-171500394 None] Creating offline snapshot 02fca045-3502-47af-880a-3353b61d3b3b of volume b0376c92-75ab-4049-a1b9-f7d94e016bd6 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:34:42 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Volume volume-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a (672a6c64-4032-4a4c-9a46-1dfa7cb2e94a): created successfully
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6de6dba-0ab6-4e54-9946-0dd651cfefd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Flow 'volume_create_manager' (38e66c93-782d-40d8-b147-9179be623c0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[737622f7-9b88-47ba-bc12-7c5983db5e93]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-934b5b7c-64cc-4f2a-8437-a7319ef50fa6 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:42 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-0afb4fdb-3d42-419d-a9a6-53fdc2293559 tempest-VolumesActionsTest-1234935443 None] Created volume successfully.
Jun 18 11:34:42 devstack sudo[102639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1
Jun 18 11:34:42 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:43 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.702s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:43 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:34:43 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-8aa0d5f8-e0f1-490e-98e4-ace4f26c0d13 tempest-GroupSnapshotsTest-1584421778 None] Delete group completed successfully.
Jun 18 11:34:43 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] Acquiring lock "cinder-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:43 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] Lock "cinder-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:43 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] Acquiring lock "cinder-quobyte-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:43 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] Lock "cinder-quobyte-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a" acquired by "delete_volume" :: waited 0.025s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:43 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[46113c32-c223-4765-b138-6709e8849d5b]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:43 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-0b932999-11f2-432a-9686-0bb1cdcf267d tempest-GroupSnapshotsTest-1584421778 None] Group tempest-GroupSnapshotsTest-Group-1778850539: creating
Jun 18 11:34:43 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-0b932999-11f2-432a-9686-0bb1cdcf267d tempest-GroupSnapshotsTest-1584421778 None] Group tempest-GroupSnapshotsTest-Group-1778850539: created successfully
Jun 18 11:34:43 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-0b932999-11f2-432a-9686-0bb1cdcf267d tempest-GroupSnapshotsTest-1584421778 None] Create group completed successfully.
Jun 18 11:34:43 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-934b5b7c-64cc-4f2a-8437-a7319ef50fa6 tempest-SnapshotsActionsTest-171500394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1" returned: 0 in 0.917s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-934b5b7c-64cc-4f2a-8437-a7319ef50fa6 tempest-SnapshotsActionsTest-171500394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:34:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-934b5b7c-64cc-4f2a-8437-a7319ef50fa6 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:43 devstack sudo[102645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a
Jun 18 11:34:43 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:43 devstack sudo[102646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b 1G
Jun 18 11:34:43 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:44 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a" returned: 0 in 0.825s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:44 devstack sudo[102657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a
Jun 18 11:34:44 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:44 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-934b5b7c-64cc-4f2a-8437-a7319ef50fa6 tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b 1G" returned: 0 in 1.029s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-934b5b7c-64cc-4f2a-8437-a7319ef50fa6 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:44 devstack sudo[102659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b
Jun 18 11:34:44 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:44 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a" returned: 0 in 0.758s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] Lock "cinder-quobyte-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a" released by "delete_volume" :: held 1.636s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] Created reservations ['a2696b13-4106-496a-8f00-d22e150d1acc', '9e2cff48-a487-4d46-8542-96960d029df6', 'f47307d4-3f2f-4d61-8a51-c1667d071b34', 'c7679571-efc8-4f5d-b66f-7c8cf4da7474'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Flow 'volume_create_manager' (0a90ca9f-f084-46be-bf4d-4eb3b8933301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefc38d7-1182-4002-b995-5620cda85a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefc38d7-1182-4002-b995-5620cda85a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-685776887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bbd2d5cd-d6ff-4dcb-aa28-fe5014023436,host='devstack@QuobyteHD#QuobyteHD',id=e65315e4-b45f-4a1c-ba45-2ae9b6cedd26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9957a7edc41b698ae63f06a2a4e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:34:45Z,use_quota=True,user_id='29840517423548ea9a20a8a4f84a5ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eaf6b56-f8c8-4744-8004-8b08a40198c1),volume_type_id=7eaf6b56-f8c8-4744-8004-8b08a40198c1)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810f3105-4050-4db3-ab10-0f61d7306321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810f3105-4050-4db3-ab10-0f61d7306321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f21ca26-b454-48f5-881d-04a1860f0505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f21ca26-b454-48f5-881d-04a1860f0505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e65315e4-b45f-4a1c-ba45-2ae9b6cedd26', 'volume_name': 'volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a358760-6e6d-4e75-92b4-334798ac92c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a358760-6e6d-4e75-92b4-334798ac92c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8869b7-d1b9-48d8-92f3-08e654172aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:45 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Volume e65315e4-b45f-4a1c-ba45-2ae9b6cedd26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26', 'volume_size': 1}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:45 devstack sudo[102666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:34:45 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:45 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-934b5b7c-64cc-4f2a-8437-a7319ef50fa6 tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b" returned: 0 in 0.950s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:45 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-934b5b7c-64cc-4f2a-8437-a7319ef50fa6 tempest-SnapshotsActionsTest-171500394 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b is being set with open permissions: ugo+rw
Jun 18 11:34:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-934b5b7c-64cc-4f2a-8437-a7319ef50fa6 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:45 devstack sudo[102668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b
Jun 18 11:34:45 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:34:46 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Flow 'volume_create_manager' (01fcb9ad-113e-4711-b5c8-6776062f7937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e302395e-e2b2-4b80-974b-1b2dba15e622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.886s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:34:46 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] Deleted volume successfully.
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e302395e-e2b2-4b80-974b-1b2dba15e622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1160702396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3cf5384-3e8c-43a0-badd-8da5970e9825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33670cbf3944b52831b6425bbe00c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:34:46Z,use_quota=True,user_id='a795cbbce53d4c87a5442983b809279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e58ddb-740a-4cab-a45e-9457231d906e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:46 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e58ddb-740a-4cab-a45e-9457231d906e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16374c34-6818-4f54-a33f-bd3915e4e83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16374c34-6818-4f54-a33f-bd3915e4e83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3cf5384-3e8c-43a0-badd-8da5970e9825', 'volume_name': 'volume-a3cf5384-3e8c-43a0-badd-8da5970e9825', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a54848-cda0-42f7-b247-6257cacaf702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a54848-cda0-42f7-b247-6257cacaf702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17bef7d5-f467-49bc-893a-7dfd22f2df40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:46 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Volume a3cf5384-3e8c-43a0-badd-8da5970e9825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3cf5384-3e8c-43a0-badd-8da5970e9825', 'volume_size': 1}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-934b5b7c-64cc-4f2a-8437-a7319ef50fa6 tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b" returned: 0 in 0.896s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-934b5b7c-64cc-4f2a-8437-a7319ef50fa6 tempest-SnapshotsActionsTest-171500394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.933s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0220cec3-bbb1-4114-9c2b-54f18b1ea5d7 tempest-VolumesActionsTest-537420732 None] Lock "cinder-672a6c64-4032-4a4c-9a46-1dfa7cb2e94a-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.036s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bbd2d5cd-d6ff-4dcb-aa28-fe5014023436,created_at=2026-06-18T09:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-685776887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bbd2d5cd-d6ff-4dcb-aa28-fe5014023436,host='devstack@QuobyteHD#QuobyteHD',id=e65315e4-b45f-4a1c-ba45-2ae9b6cedd26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9957a7edc41b698ae63f06a2a4e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:34:45Z,use_quota=True,user_id='29840517423548ea9a20a8a4f84a5ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eaf6b56-f8c8-4744-8004-8b08a40198c1),volume_type_id=7eaf6b56-f8c8-4744-8004-8b08a40198c1)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Creating volume e65315e4-b45f-4a1c-ba45-2ae9b6cedd26 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:34:46 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:34:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:46 devstack sudo[102673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26 1073741824
Jun 18 11:34:46 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:46 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-934b5b7c-64cc-4f2a-8437-a7319ef50fa6 tempest-SnapshotsActionsTest-171500394 None] Create snapshot completed successfully
Jun 18 11:34:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Acquiring lock "cinder-02fca045-3502-47af-880a-3353b61d3b3b-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-02fca045-3502-47af-880a-3353b61d3b3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Acquiring lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Acquiring lock "cinder-quobyte-02fca045-3502-47af-880a-3353b61d3b3b" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-quobyte-02fca045-3502-47af-880a-3353b61d3b3b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Deleting offline snapshot 02fca045-3502-47af-880a-3353b61d3b3b of volume b0376c92-75ab-4049-a1b9-f7d94e016bd6 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:34:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] snapshot_file for this snap is: volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:34:47 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a59603-fcfd-4025-8b08-8aec0bfa9728]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:47 devstack sudo[102679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b
Jun 18 11:34:47 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26 1073741824" returned: 0 in 0.962s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:47 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:47 devstack sudo[102681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26
Jun 18 11:34:47 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:48 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b" returned: 0 in 0.922s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a5be55-abef-40f5-bd27-24d1346fb605]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:48 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26" returned: 0 in 0.731s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.872s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1160702396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3cf5384-3e8c-43a0-badd-8da5970e9825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33670cbf3944b52831b6425bbe00c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:34:46Z,use_quota=True,user_id='a795cbbce53d4c87a5442983b809279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Creating volume a3cf5384-3e8c-43a0-badd-8da5970e9825 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:34:48 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3cf5384-3e8c-43a0-badd-8da5970e9825 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:48 devstack sudo[102688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3cf5384-3e8c-43a0-badd-8da5970e9825 1073741824
Jun 18 11:34:48 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8869b7-d1b9-48d8-92f3-08e654172aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5852c1-1a6a-40f8-aaf1-8405b2905ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:48 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Volume volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26 (e65315e4-b45f-4a1c-ba45-2ae9b6cedd26): created successfully
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5852c1-1a6a-40f8-aaf1-8405b2905ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Flow 'volume_create_manager' (0a90ca9f-f084-46be-bf4d-4eb3b8933301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:34:48 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-9512a602-dfae-455a-a9b6-111097af71d1 tempest-GroupSnapshotsTest-1584421778 None] Created volume successfully.
Jun 18 11:34:48 devstack sudo[102687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1
Jun 18 11:34:48 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:49 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1" returned: 0 in 0.953s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:49 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:34:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:49 devstack sudo[102700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b
Jun 18 11:34:49 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:49 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3cf5384-3e8c-43a0-badd-8da5970e9825 1073741824" returned: 0 in 1.107s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3cf5384-3e8c-43a0-badd-8da5970e9825 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:49 devstack sudo[102703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3cf5384-3e8c-43a0-badd-8da5970e9825
Jun 18 11:34:49 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:49 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:34:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Flow 'volume_create_manager' (c9a09474-42f5-40d1-9ce7-ef34a42c2f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:34:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cb2832-c0e8-4175-8a9a-e9e541bdac57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cb2832-c0e8-4175-8a9a-e9e541bdac57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-864955359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bbd2d5cd-d6ff-4dcb-aa28-fe5014023436,host='devstack@QuobyteHD#QuobyteHD',id=b1503a99-caa9-4ac3-9c50-4697d3ddfe0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9957a7edc41b698ae63f06a2a4e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:34:49Z,use_quota=True,user_id='29840517423548ea9a20a8a4f84a5ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eaf6b56-f8c8-4744-8004-8b08a40198c1),volume_type_id=7eaf6b56-f8c8-4744-8004-8b08a40198c1)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a2b65a-a028-4f16-854e-ea6a72df99ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a2b65a-a028-4f16-854e-ea6a72df99ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8774bce2-2b30-47b8-902b-cb95d1a86f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8774bce2-2b30-47b8-902b-cb95d1a86f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1503a99-caa9-4ac3-9c50-4697d3ddfe0d', 'volume_name': 'volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3d668f-03a5-409d-9d7b-9ff978b54f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3d668f-03a5-409d-9d7b-9ff978b54f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38ed19b-e484-4441-9a1d-e4eb501e9452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:49 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Volume b1503a99-caa9-4ac3-9c50-4697d3ddfe0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d', 'volume_size': 1}
Jun 18 11:34:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:50 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3cf5384-3e8c-43a0-badd-8da5970e9825" returned: 0 in 0.695s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.503s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bbd2d5cd-d6ff-4dcb-aa28-fe5014023436,created_at=2026-06-18T09:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-864955359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bbd2d5cd-d6ff-4dcb-aa28-fe5014023436,host='devstack@QuobyteHD#QuobyteHD',id=b1503a99-caa9-4ac3-9c50-4697d3ddfe0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9957a7edc41b698ae63f06a2a4e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:34:49Z,use_quota=True,user_id='29840517423548ea9a20a8a4f84a5ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eaf6b56-f8c8-4744-8004-8b08a40198c1),volume_type_id=7eaf6b56-f8c8-4744-8004-8b08a40198c1)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Creating volume b1503a99-caa9-4ac3-9c50-4697d3ddfe0d {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:34:50 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:50 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17bef7d5-f467-49bc-893a-7dfd22f2df40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3cf5384-3e8c-43a0-badd-8da5970e9825', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:50 devstack sudo[102710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d 1073741824
Jun 18 11:34:50 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba97fbb-d912-466f-af9e-b54234246576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b" returned: 0 in 1.036s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:50 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Volume volume-a3cf5384-3e8c-43a0-badd-8da5970e9825 (a3cf5384-3e8c-43a0-badd-8da5970e9825): created successfully
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba97fbb-d912-466f-af9e-b54234246576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Flow 'volume_create_manager' (01fcb9ad-113e-4711-b5c8-6776062f7937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:34:50 devstack sudo[102713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b
Jun 18 11:34:50 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:50 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-70cc6cc1-4d80-4be3-a54d-80926f16f7be tempest-VolumesActionsTest-1234935443 None] Created volume successfully.
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] Acquiring lock "cinder-a3cf5384-3e8c-43a0-badd-8da5970e9825-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] Lock "cinder-a3cf5384-3e8c-43a0-badd-8da5970e9825-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] Acquiring lock "cinder-quobyte-a3cf5384-3e8c-43a0-badd-8da5970e9825" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] Lock "cinder-quobyte-a3cf5384-3e8c-43a0-badd-8da5970e9825" acquired by "delete_volume" :: waited 0.027s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3e4655-0d70-4db2-8c59-a341a8a8dcfb]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3cf5384-3e8c-43a0-badd-8da5970e9825 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:51 devstack sudo[102718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3cf5384-3e8c-43a0-badd-8da5970e9825
Jun 18 11:34:51 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:51 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.02fca045-3502-47af-880a-3353b61d3b3b" returned: 0 in 0.884s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-quobyte-02fca045-3502-47af-880a-3353b61d3b3b" released by "_delete_snapshot" :: held 3.947s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" released by "delete_snapshot" :: held 3.981s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:51 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d 1073741824" returned: 0 in 1.041s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:51 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Created reservations ['30a2ede1-8096-4e00-8e82-2a349ebbed2e', 'b934cdd4-13ee-457a-af3c-99f2a103f427', '55d74c83-df95-422c-94a4-744acb387de3', '0569e629-64f5-4ed7-b3aa-4394f2d9c97d'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:34:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:51 devstack sudo[102722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d
Jun 18 11:34:51 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:51 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Delete snapshot completed successfully.
Jun 18 11:34:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4fcc93cc-eaa4-48a6-8e8c-6b8d87b21ea0 tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-02fca045-3502-47af-880a-3353b61d3b3b-delete_snapshot" released by "delete_snapshot" :: held 4.263s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fad92633-a87e-4fb1-9865-a1d20d982e8b tempest-SnapshotsActionsTest-171500394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3cf5384-3e8c-43a0-badd-8da5970e9825" returned: 0 in 1.029s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3cf5384-3e8c-43a0-badd-8da5970e9825 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:51 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:52 devstack sudo[102727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3cf5384-3e8c-43a0-badd-8da5970e9825
Jun 18 11:34:52 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:52 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d" returned: 0 in 1.031s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] <== create_volume: return (2130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.133s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fad92633-a87e-4fb1-9865-a1d20d982e8b tempest-SnapshotsActionsTest-171500394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.393s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-fad92633-a87e-4fb1-9865-a1d20d982e8b tempest-SnapshotsActionsTest-171500394 None] Creating offline snapshot 8242e648-6173-4f38-8dd1-6434c82bc898 of volume b0376c92-75ab-4049-a1b9-f7d94e016bd6 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38ed19b-e484-4441-9a1d-e4eb501e9452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c45365-a01b-4ca7-b30c-d6689ea426d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43881bc-57f3-41fa-9c1b-05431877facf]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fad92633-a87e-4fb1-9865-a1d20d982e8b tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:52 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Volume volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d (b1503a99-caa9-4ac3-9c50-4697d3ddfe0d): created successfully
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c45365-a01b-4ca7-b30c-d6689ea426d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Flow 'volume_create_manager' (c9a09474-42f5-40d1-9ce7-ef34a42c2f3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:34:52 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-bf431b84-c85a-4062-b07e-2edc8330d77e tempest-GroupSnapshotsTest-1584421778 None] Created volume successfully.
Jun 18 11:34:52 devstack sudo[102730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1
Jun 18 11:34:52 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:52 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a3cf5384-3e8c-43a0-badd-8da5970e9825" returned: 0 in 0.743s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] Lock "cinder-quobyte-a3cf5384-3e8c-43a0-badd-8da5970e9825" released by "delete_volume" :: held 1.830s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] Created reservations ['aa25d616-209f-4715-a6f3-dd194c8041dc', 'ff39b7f2-6d59-4772-b970-d788381e3a09', '69a763e0-eac1-4322-bd8d-68b4ded5674d', '68e36938-2cd7-4b42-864d-765360d514a1'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:52 devstack sudo[102734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:34:52 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:53 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fad92633-a87e-4fb1-9865-a1d20d982e8b tempest-SnapshotsActionsTest-171500394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1" returned: 0 in 1.119s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-fad92633-a87e-4fb1-9865-a1d20d982e8b tempest-SnapshotsActionsTest-171500394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fad92633-a87e-4fb1-9865-a1d20d982e8b tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:53 devstack sudo[102739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898 1G
Jun 18 11:34:53 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:53 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-a47eda65-c6b3-43fd-899c-74468719f8ab tempest-GroupSnapshotsTest-1584421778 None] Update group completed successfully.
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:34:53 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Flow 'volume_create_manager' (24c01894-749e-4aa1-9144-5fe86e065d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4aa89c7-8307-4fe5-ac16-06e6e0ae41e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.903s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:34:53 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] Deleted volume successfully.
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4aa89c7-8307-4fe5-ac16-06e6e0ae41e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1893119542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a9f3f3-3a0f-4982-830a-aa5d9cec588e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33670cbf3944b52831b6425bbe00c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:34:54Z,use_quota=True,user_id='a795cbbce53d4c87a5442983b809279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781b2cbe-c18b-43a6-bad9-8769ad0ddcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781b2cbe-c18b-43a6-bad9-8769ad0ddcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741ee8ce-c0be-45a7-9151-29b1e3d1b564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741ee8ce-c0be-45a7-9151-29b1e3d1b564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0a9f3f3-3a0f-4982-830a-aa5d9cec588e', 'volume_name': 'volume-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a27d7e-f3b8-4cfe-83c4-80924f354413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a27d7e-f3b8-4cfe-83c4-80924f354413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e069bca-d13d-44f9-9a6b-923ce9f26553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:53 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Volume e0a9f3f3-3a0f-4982-830a-aa5d9cec588e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e', 'volume_size': 1}
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fca446d6-7da4-41ed-8cc0-e23ededf59c0 tempest-VolumesActionsTest-537420732 None] Lock "cinder-a3cf5384-3e8c-43a0-badd-8da5970e9825-delete_volume" released by "delete_volume" :: held 3.067s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:54 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fad92633-a87e-4fb1-9865-a1d20d982e8b tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898 1G" returned: 0 in 1.018s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fad92633-a87e-4fb1-9865-a1d20d982e8b tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:54 devstack sudo[102746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898
Jun 18 11:34:54 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:54 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-eac7f8dc-5ee0-456d-9b7c-906b1c39a2cb tempest-GroupSnapshotsTest-1584421778 None] Update group completed successfully.
Jun 18 11:34:55 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fad92633-a87e-4fb1-9865-a1d20d982e8b tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898" returned: 0 in 0.759s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:55 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-fad92633-a87e-4fb1-9865-a1d20d982e8b tempest-SnapshotsActionsTest-171500394 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898 is being set with open permissions: ugo+rw
Jun 18 11:34:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fad92633-a87e-4fb1-9865-a1d20d982e8b tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:55 devstack sudo[102751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898
Jun 18 11:34:55 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:55 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fad92633-a87e-4fb1-9865-a1d20d982e8b tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898" returned: 0 in 0.666s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fad92633-a87e-4fb1-9865-a1d20d982e8b tempest-SnapshotsActionsTest-171500394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.685s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.137s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:55 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1893119542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a9f3f3-3a0f-4982-830a-aa5d9cec588e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33670cbf3944b52831b6425bbe00c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:34:54Z,use_quota=True,user_id='a795cbbce53d4c87a5442983b809279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:34:55 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Creating volume e0a9f3f3-3a0f-4982-830a-aa5d9cec588e {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:34:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:55 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:34:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:34:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:34:56 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:34:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:56 devstack sudo[102754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e 1073741824
Jun 18 11:34:56 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:56 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-f89b722d-e4f7-446b-9160-31cbaa422fe1 tempest-GroupSnapshotsTest-1584421778 None] Update group completed successfully.
Jun 18 11:34:56 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-fad92633-a87e-4fb1-9865-a1d20d982e8b tempest-SnapshotsActionsTest-171500394 None] Create snapshot completed successfully
Jun 18 11:34:56 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e 1073741824" returned: 0 in 0.867s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:56 devstack sudo[102760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e
Jun 18 11:34:56 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:57 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d021181c-5c0f-4f34-a5aa-d8f3478f7cf5 tempest-GroupSnapshotsTest-1584421778 None] Update group completed successfully.
Jun 18 11:34:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Acquiring lock "cinder-8242e648-6173-4f38-8dd1-6434c82bc898-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-8242e648-6173-4f38-8dd1-6434c82bc898-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Acquiring lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Acquiring lock "cinder-quobyte-8242e648-6173-4f38-8dd1-6434c82bc898" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-quobyte-8242e648-6173-4f38-8dd1-6434c82bc898" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Deleting offline snapshot 8242e648-6173-4f38-8dd1-6434c82bc898 of volume b0376c92-75ab-4049-a1b9-f7d94e016bd6 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:34:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] snapshot_file for this snap is: volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:34:57 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9577ef-b420-4f5b-96fb-2102e71660aa]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:57 devstack sudo[102762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898
Jun 18 11:34:57 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:57 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e" returned: 0 in 0.696s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:34:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:34:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e069bca-d13d-44f9-9a6b-923ce9f26553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638f9d66-3736-4c31-baeb-cacf2064e43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:34:57 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Volume volume-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e (e0a9f3f3-3a0f-4982-830a-aa5d9cec588e): created successfully
Jun 18 11:34:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638f9d66-3736-4c31-baeb-cacf2064e43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:34:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Flow 'volume_create_manager' (24c01894-749e-4aa1-9144-5fe86e065d13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:34:57 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-a6f0a267-57ce-419c-9b04-f1e96b21fc24 tempest-VolumesActionsTest-1234935443 None] Created volume successfully.
Jun 18 11:34:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] Acquiring lock "cinder-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] Lock "cinder-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] Acquiring lock "cinder-quobyte-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:34:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] Lock "cinder-quobyte-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e" acquired by "delete_volume" :: waited 0.028s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:34:58 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[1217e9e4-0d2f-435d-aa9a-a98e86d2786a]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:58 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898" returned: 0 in 0.862s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:34:58 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb860c16-782a-4224-8d3c-647266db2c16]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:58 devstack sudo[102769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e
Jun 18 11:34:58 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:58 devstack sudo[102770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1
Jun 18 11:34:58 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:58 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] GroupSnapshot 52b74244-00a8-4180-a75e-b1eedbf5441c: creating.
Jun 18 11:34:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Group snapshot 52b74244-00a8-4180-a75e-b1eedbf5441c: creating. {{(pid=91663) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 18 11:34:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:34:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:34:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Creating offline snapshot 6ef6cd66-20cc-4b18-813d-1d638eceb92b of volume b1503a99-caa9-4ac3-9c50-4697d3ddfe0d {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:34:58 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b93ad1c-8453-42eb-aa2b-be0001088b75]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:34:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:58 devstack sudo[102773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d
Jun 18 11:34:58 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:59 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e" returned: 0 in 0.900s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:59 devstack sudo[102782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e
Jun 18 11:34:59 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:59 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1" returned: 0 in 0.898s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:34:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:59 devstack sudo[102784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898
Jun 18 11:34:59 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:59 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d" returned: 0 in 0.976s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:34:59 devstack sudo[102792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b 1G
Jun 18 11:34:59 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:34:59 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root
Jun 18 11:34:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e" returned: 0 in 0.760s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:34:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] Lock "cinder-quobyte-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e" released by "delete_volume" :: held 1.718s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:34:59 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] Created reservations ['094ca92b-77dd-40d3-870b-ec092d5d26d7', '276bba09-dc52-4d4f-b130-78213af2e803', '0d7cda8d-7135-495d-a074-12988ee15952', '2204ba37-1081-4550-ab4a-ad4a4cefecdc'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:00 devstack sudo[102796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:35:00 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:00 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898" returned: 0 in 0.934s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:00 devstack sudo[102799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898
Jun 18 11:35:00 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Flow 'volume_create_manager' (bcd83616-2029-4d54-a8e3-395b16afc9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0bab08-160a-4ad2-bcc6-e848854e8858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0bab08-160a-4ad2-bcc6-e848854e8858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07be3353-61c6-4444-ba53-6591fbf71dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3a6944a8c945b0b0ee0db3ae57a8cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:35:00Z,use_quota=True,user_id='58fa62a038d5445ba5ea3b9e3881e03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8113d4ef-f7ba-476d-bee1-99459aed22e2),volume_type_id=8113d4ef-f7ba-476d-bee1-99459aed22e2)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b6b234-cf74-4abb-9265-616d06ec328b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b6b234-cf74-4abb-9265-616d06ec328b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30c37c6-ab52-481a-b5d6-c32c11116e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG cinder.image.glance [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Creating Keystone auth plugin from conf {{(pid=91663) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 18 11:35:00 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b 1G" returned: 0 in 1.051s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:00 devstack sudo[102806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b
Jun 18 11:35:00 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:00 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.929s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:00 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:35:00 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] Deleted volume successfully.
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-03932061-cf90-4fd9-9300-c1d0cb817ec5 tempest-VolumesActionsTest-537420732 None] Lock "cinder-e0a9f3f3-3a0f-4982-830a-aa5d9cec588e-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30c37c6-ab52-481a-b5d6-c32c11116e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '07be3353-61c6-4444-ba53-6591fbf71dbb', 'volume_name': 'volume-07be3353-61c6-4444-ba53-6591fbf71dbb', 'volume_size': 1, 'image_id': '69f57b7e-486d-4eb2-8cd0-f98c0ed6b388', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69f57b7e-486d-4eb2-8cd0-f98c0ed6b388', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f53eec0507d8f69f3f8effcd72eb5808', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e3a6944a8c945b0b0ee0db3ae57a8cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2fcb1d2c363010025f32f76714f97fe3a9928382a63be76d3a96ad3ed7708a436c683dd4131d87ee1ff272c7bd44f280ece6d0e091159574fa9d1256bb486457', 'id': '69f57b7e-486d-4eb2-8cd0-f98c0ed6b388', 'created_at': datetime.datetime(2026, 6, 18, 9, 34, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 34, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69f57b7e-486d-4eb2-8cd0-f98c0ed6b388/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ff0fd42c0>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d828b6f8-f43d-4192-be03-a28546f0ff2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d828b6f8-f43d-4192-be03-a28546f0ff2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9523082-3c6f-4bc7-bc97-65034745fb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:01 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Volume 07be3353-61c6-4444-ba53-6591fbf71dbb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-07be3353-61c6-4444-ba53-6591fbf71dbb', 'volume_size': 1, 'image_id': '69f57b7e-486d-4eb2-8cd0-f98c0ed6b388', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69f57b7e-486d-4eb2-8cd0-f98c0ed6b388', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f53eec0507d8f69f3f8effcd72eb5808', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e3a6944a8c945b0b0ee0db3ae57a8cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2fcb1d2c363010025f32f76714f97fe3a9928382a63be76d3a96ad3ed7708a436c683dd4131d87ee1ff272c7bd44f280ece6d0e091159574fa9d1256bb486457', 'id': '69f57b7e-486d-4eb2-8cd0-f98c0ed6b388', 'created_at': datetime.datetime(2026, 6, 18, 9, 34, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 34, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69f57b7e-486d-4eb2-8cd0-f98c0ed6b388/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ff0fd42c0>}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Trying to clone 07be3353-61c6-4444-ba53-6591fbf71dbb from image 69f57b7e-486d-4eb2-8cd0-f98c0ed6b388 at location (None, [{'url': 'file:///opt/stack/data/glance/images/69f57b7e-486d-4eb2-8cd0-f98c0ed6b388', 'metadata': {}}]). {{(pid=91663) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 18 11:35:01 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.8242e648-6173-4f38-8dd1-6434c82bc898" returned: 0 in 1.012s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-quobyte-8242e648-6173-4f38-8dd1-6434c82bc898" released by "_delete_snapshot" :: held 3.847s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" released by "delete_snapshot" :: held 3.877s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Flow 'volume_create_manager' (50e6bfc9-2735-43c7-a36b-62b0e249ab8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8766dabd-2452-4d3b-8d73-68cef576f697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 18 11:35:01 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Image download 0.00 MB at 0.00 MB/s
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8766dabd-2452-4d3b-8d73-68cef576f697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1030253680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6407b13f-cb5a-471b-9d54-b3a7c6a5a595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33670cbf3944b52831b6425bbe00c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:35:01Z,use_quota=True,user_id='a795cbbce53d4c87a5442983b809279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678fae19-a70a-4a7d-af9d-7a3fe176b5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678fae19-a70a-4a7d-af9d-7a3fe176b5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6067a8c5-2c61-49cd-9162-5e479f04a4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6067a8c5-2c61-49cd-9162-5e479f04a4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6407b13f-cb5a-471b-9d54-b3a7c6a5a595', 'volume_name': 'volume-6407b13f-cb5a-471b-9d54-b3a7c6a5a595', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f97b2f-6f0e-4a13-8a1f-61f3ec1d0fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f97b2f-6f0e-4a13-8a1f-61f3ec1d0fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4346283-a0d4-4713-a517-4aaaa870f50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:01 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Volume 6407b13f-cb5a-471b-9d54-b3a7c6a5a595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6407b13f-cb5a-471b-9d54-b3a7c6a5a595', 'volume_size': 1}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[768e4178-faed-473e-94c9-344ecfae80d3]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Created reservations ['7b22bf20-4555-4bfe-81ea-680c9da81e9f', 'c41ebec3-4455-43a4-b10a-148b8f160896', '0b61674f-d6ba-44b3-84a2-67af35180376', 'd54bfefb-1ffd-4d86-be04-e30de8af005c'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:01 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Delete snapshot completed successfully.
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ee15279a-d89a-4710-aa78-84ec384e5f9d tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-8242e648-6173-4f38-8dd1-6434c82bc898-delete_snapshot" released by "delete_snapshot" :: held 4.158s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:01 devstack sudo[102812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD
Jun 18 11:35:01 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:01 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b" returned: 0 in 0.930s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:01 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b is being set with open permissions: ugo+rw: NotImplementedError
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:01 devstack sudo[102818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b
Jun 18 11:35:01 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f63b4d26-4179-4e7d-8292-b0175ca59c4b tempest-SnapshotsActionsTest-171500394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:02 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD" returned: 0 in 0.866s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:02 devstack sudo[102822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD
Jun 18 11:35:02 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:02 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b" returned: 0 in 0.701s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:02 devstack sudo[102825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.info
Jun 18 11:35:02 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:02 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD" returned: 1 in 0.710s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:35:02 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Temporary image 69f57b7e-486d-4eb2-8cd0-f98c0ed6b388 is fetched for user 58fa62a038d5445ba5ea3b9e3881e03c. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 18 11:35:03 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efb3f31-94c6-4932-a68f-0e835c260923]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:03 devstack sudo[102832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD
Jun 18 11:35:03 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:03 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.info" returned: 0 in 0.656s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:03 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 18 11:35:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:03 devstack sudo[102835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.info
Jun 18 11:35:03 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:03 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD" returned: 0 in 0.737s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:03 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.info" returned: 0 in 0.644s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.057s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:03 devstack sudo[102841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD
Jun 18 11:35:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:03 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Creating offline snapshot 7d0d7ee7-8214-4352-8a3b-1186b1fdf053 of volume e65315e4-b45f-4a1c-ba45-2ae9b6cedd26 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:35:03 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3d71b9-b5a6-4fa0-a6a1-d8730adb7b13]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:04 devstack sudo[102843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26
Jun 18 11:35:04 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:04 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD" returned: 1 in 0.730s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:35:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:04 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26" returned: 0 in 0.746s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:04 devstack sudo[102851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053 1G
Jun 18 11:35:04 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:05 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053 1G" returned: 0 in 0.795s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:05 devstack sudo[102857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053
Jun 18 11:35:05 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:06 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053" returned: 0 in 0.663s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:06 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053 is being set with open permissions: ugo+rw: NotImplementedError
Jun 18 11:35:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:06 devstack sudo[102868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053
Jun 18 11:35:06 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:06 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053" returned: 0 in 0.617s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:06 devstack sudo[102871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.info
Jun 18 11:35:06 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:07 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.info" returned: 0 in 0.639s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:07 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 18 11:35:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:07 devstack sudo[102874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.info
Jun 18 11:35:07 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:08 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.info" returned: 0 in 0.618s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.157s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f63b4d26-4179-4e7d-8292-b0175ca59c4b tempest-SnapshotsActionsTest-171500394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.040s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-f63b4d26-4179-4e7d-8292-b0175ca59c4b tempest-SnapshotsActionsTest-171500394 None] Creating offline snapshot 47b808a4-31f2-43e8-9ab6-5219bd7b3035 of volume b0376c92-75ab-4049-a1b9-f7d94e016bd6 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:35:08 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bda839e-9470-41ed-9488-72c3697377e5]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f63b4d26-4179-4e7d-8292-b0175ca59c4b tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:08 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d12c0a20-a88e-4ebc-a700-4dbed4e3b713 tempest-GroupSnapshotsTest-1584421778 None] group_snapshot 52b74244-00a8-4180-a75e-b1eedbf5441c: created successfully
Jun 18 11:35:08 devstack sudo[102877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1
Jun 18 11:35:08 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:08 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f63b4d26-4179-4e7d-8292-b0175ca59c4b tempest-SnapshotsActionsTest-171500394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1" returned: 0 in 0.777s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-f63b4d26-4179-4e7d-8292-b0175ca59c4b tempest-SnapshotsActionsTest-171500394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:35:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f63b4d26-4179-4e7d-8292-b0175ca59c4b tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:08 devstack sudo[102882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035 1G
Jun 18 11:35:08 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:09 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] group_snapshot 52b74244-00a8-4180-a75e-b1eedbf5441c: deleting
Jun 18 11:35:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] group_snapshot 52b74244-00a8-4180-a75e-b1eedbf5441c: deleting {{(pid=91663) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 18 11:35:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "cinder-quobyte-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "cinder-quobyte-6ef6cd66-20cc-4b18-813d-1d638eceb92b" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-6ef6cd66-20cc-4b18-813d-1d638eceb92b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Deleting offline snapshot 6ef6cd66-20cc-4b18-813d-1d638eceb92b of volume b1503a99-caa9-4ac3-9c50-4697d3ddfe0d {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:35:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] snapshot_file for this snap is: volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:35:09 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[78668c21-aa75-49c2-8ef1-44b0beefaaa2]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:09 devstack sudo[102888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b
Jun 18 11:35:09 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:09 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f63b4d26-4179-4e7d-8292-b0175ca59c4b tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035 1G" returned: 0 in 0.865s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f63b4d26-4179-4e7d-8292-b0175ca59c4b tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:09 devstack sudo[102891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035
Jun 18 11:35:09 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:10 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b" returned: 0 in 0.764s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:35:10 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[30293cbe-c24a-4ae3-9116-3105a95e5f7d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:10 devstack sudo[102896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d
Jun 18 11:35:10 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:10 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f63b4d26-4179-4e7d-8292-b0175ca59c4b tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035" returned: 0 in 0.705s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:10 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-f63b4d26-4179-4e7d-8292-b0175ca59c4b tempest-SnapshotsActionsTest-171500394 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035 is being set with open permissions: ugo+rw
Jun 18 11:35:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f63b4d26-4179-4e7d-8292-b0175ca59c4b tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:10 devstack sudo[102901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035
Jun 18 11:35:10 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:11 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d" returned: 0 in 0.775s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:11 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f63b4d26-4179-4e7d-8292-b0175ca59c4b tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035" returned: 0 in 0.636s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:11 devstack sudo[102907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b
Jun 18 11:35:11 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f63b4d26-4179-4e7d-8292-b0175ca59c4b tempest-SnapshotsActionsTest-171500394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.080s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.766s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1030253680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6407b13f-cb5a-471b-9d54-b3a7c6a5a595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33670cbf3944b52831b6425bbe00c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:35:01Z,use_quota=True,user_id='a795cbbce53d4c87a5442983b809279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Creating volume 6407b13f-cb5a-471b-9d54-b3a7c6a5a595 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:35:11 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6407b13f-cb5a-471b-9d54-b3a7c6a5a595 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:11 devstack sudo[102909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6407b13f-cb5a-471b-9d54-b3a7c6a5a595 1073741824
Jun 18 11:35:11 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:11 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-f63b4d26-4179-4e7d-8292-b0175ca59c4b tempest-SnapshotsActionsTest-171500394 None] Create snapshot completed successfully
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Acquiring lock "cinder-47b808a4-31f2-43e8-9ab6-5219bd7b3035-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-47b808a4-31f2-43e8-9ab6-5219bd7b3035-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Acquiring lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Acquiring lock "cinder-quobyte-47b808a4-31f2-43e8-9ab6-5219bd7b3035" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-quobyte-47b808a4-31f2-43e8-9ab6-5219bd7b3035" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Deleting offline snapshot 47b808a4-31f2-43e8-9ab6-5219bd7b3035 of volume b0376c92-75ab-4049-a1b9-f7d94e016bd6 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] snapshot_file for this snap is: volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e02d40a-051c-47f0-8448-cd477a57cbd2]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:11 devstack sudo[102911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035
Jun 18 11:35:11 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:11 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b" returned: 0 in 0.786s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:11 devstack sudo[102920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b
Jun 18 11:35:11 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:12 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6407b13f-cb5a-471b-9d54-b3a7c6a5a595 1073741824" returned: 0 in 0.896s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6407b13f-cb5a-471b-9d54-b3a7c6a5a595 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:12 devstack sudo[102922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6407b13f-cb5a-471b-9d54-b3a7c6a5a595
Jun 18 11:35:12 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:12 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035" returned: 0 in 0.864s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[778d292f-6ce7-445d-92d1-21eefd8f3a8a]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:12 devstack sudo[102927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1
Jun 18 11:35:12 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:12 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d.6ef6cd66-20cc-4b18-813d-1d638eceb92b" returned: 0 in 0.681s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-6ef6cd66-20cc-4b18-813d-1d638eceb92b" released by "_delete_snapshot" :: held 3.110s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d" released by "delete_snapshot" :: held 3.131s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "cinder-quobyte-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26" acquired by "delete_snapshot" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "cinder-quobyte-7d0d7ee7-8214-4352-8a3b-1186b1fdf053" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-7d0d7ee7-8214-4352-8a3b-1186b1fdf053" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Deleting offline snapshot 7d0d7ee7-8214-4352-8a3b-1186b1fdf053 of volume e65315e4-b45f-4a1c-ba45-2ae9b6cedd26 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] snapshot_file for this snap is: volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34ce21a-9317-4857-a0a6-9766bbc03e62]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:12 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6407b13f-cb5a-471b-9d54-b3a7c6a5a595" returned: 0 in 0.688s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.253s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07be3353-61c6-4444-ba53-6591fbf71dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3a6944a8c945b0b0ee0db3ae57a8cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:35:00Z,use_quota=True,user_id='58fa62a038d5445ba5ea3b9e3881e03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8113d4ef-f7ba-476d-bee1-99459aed22e2),volume_type_id=8113d4ef-f7ba-476d-bee1-99459aed22e2)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Creating volume 07be3353-61c6-4444-ba53-6591fbf71dbb {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:35:12 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:12 devstack sudo[102931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053
Jun 18 11:35:12 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:12 devstack sudo[102932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb 1073741824
Jun 18 11:35:12 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4346283-a0d4-4713-a517-4aaaa870f50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6407b13f-cb5a-471b-9d54-b3a7c6a5a595', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea6c6f9-4d4d-4903-88ed-4fc005394b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:12 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Volume volume-6407b13f-cb5a-471b-9d54-b3a7c6a5a595 (6407b13f-cb5a-471b-9d54-b3a7c6a5a595): created successfully
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea6c6f9-4d4d-4903-88ed-4fc005394b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Flow 'volume_create_manager' (50e6bfc9-2735-43c7-a36b-62b0e249ab8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:35:12 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-c5df9bb9-bc9c-447d-88df-202d35c23b55 tempest-VolumesActionsTest-1234935443 None] Created volume successfully.
Jun 18 11:35:13 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1" returned: 0 in 0.852s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:35:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:13 devstack sudo[102938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035
Jun 18 11:35:13 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:13 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053" returned: 0 in 0.760s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:35:13 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[2467d590-61cb-420f-9cd4-2569f7561ef4]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:13 devstack sudo[102946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26
Jun 18 11:35:13 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:13 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb 1073741824" returned: 0 in 0.920s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:13 devstack sudo[102949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb
Jun 18 11:35:13 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:14 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035" returned: 0 in 0.924s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:14 devstack sudo[102957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035
Jun 18 11:35:14 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:14 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26" returned: 0 in 0.920s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:14 devstack sudo[102960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053
Jun 18 11:35:14 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:14 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb" returned: 0 in 0.824s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] Acquiring lock "cinder-6407b13f-cb5a-471b-9d54-b3a7c6a5a595-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Attempting download of 69f57b7e-486d-4eb2-8cd0-f98c0ed6b388 ((None, [{'url': 'file:///opt/stack/data/glance/images/69f57b7e-486d-4eb2-8cd0-f98c0ed6b388', 'metadata': {}}])) to volume 07be3353-61c6-4444-ba53-6591fbf71dbb. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] Lock "cinder-6407b13f-cb5a-471b-9d54-b3a7c6a5a595-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9030912-b1f3-45e0-b93c-106269b1a704]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_mi7fi67g {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] Acquiring lock "cinder-quobyte-6407b13f-cb5a-471b-9d54-b3a7c6a5a595" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] Lock "cinder-quobyte-6407b13f-cb5a-471b-9d54-b3a7c6a5a595" acquired by "delete_volume" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c29640-8b20-4445-a71a-a51b29792ecc]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6407b13f-cb5a-471b-9d54-b3a7c6a5a595 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:14 devstack sudo[102963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_mi7fi67g
Jun 18 11:35:14 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:14 devstack sudo[102964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6407b13f-cb5a-471b-9d54-b3a7c6a5a595
Jun 18 11:35:14 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:14 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.47b808a4-31f2-43e8-9ab6-5219bd7b3035" returned: 0 in 0.748s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-quobyte-47b808a4-31f2-43e8-9ab6-5219bd7b3035" released by "_delete_snapshot" :: held 3.495s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" released by "delete_snapshot" :: held 3.532s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:15 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Created reservations ['31969f71-9d83-4167-93ac-25f247c93111', '9808c387-3b27-434e-9f80-28606719fc22', '5a62674b-ab8d-4eb2-8143-71f695f1162b', '5c905cac-5083-46c4-85ce-084f388bf9c1'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:15 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Delete snapshot completed successfully.
Jun 18 11:35:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-117a62c7-db6f-463f-8b01-3bdeceb7246a tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-47b808a4-31f2-43e8-9ab6-5219bd7b3035-delete_snapshot" released by "delete_snapshot" :: held 3.696s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:15 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053" returned: 0 in 0.859s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:15 devstack sudo[102973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053
Jun 18 11:35:15 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:15 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_mi7fi67g" returned: 0 in 0.853s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_mi7fi67g {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:15 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6407b13f-cb5a-471b-9d54-b3a7c6a5a595" returned: 0 in 0.866s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6407b13f-cb5a-471b-9d54-b3a7c6a5a595 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:15 devstack sudo[102981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6407b13f-cb5a-471b-9d54-b3a7c6a5a595
Jun 18 11:35:15 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:15 devstack sudo[102980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_mi7fi67g
Jun 18 11:35:15 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:15 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26.7d0d7ee7-8214-4352-8a3b-1186b1fdf053" returned: 0 in 0.724s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-7d0d7ee7-8214-4352-8a3b-1186b1fdf053" released by "_delete_snapshot" :: held 3.412s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26" released by "delete_snapshot" :: held 3.437s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2cc98a9b-8a82-42ea-9008-07932b3ab603 tempest-SnapshotsActionsTest-171500394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2cc98a9b-8a82-42ea-9008-07932b3ab603 tempest-SnapshotsActionsTest-171500394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2cc98a9b-8a82-42ea-9008-07932b3ab603 tempest-SnapshotsActionsTest-171500394 None] Creating offline snapshot 15932505-7910-449a-8c01-6e2d6654eb8d of volume b0376c92-75ab-4049-a1b9-f7d94e016bd6 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c409d7-a6e5-4675-b698-77a98b0b628f]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2cc98a9b-8a82-42ea-9008-07932b3ab603 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:16 devstack cinder-volume[91663]: WARNING cinder.quota [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-105663273 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-105663273, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:35:16 devstack cinder-volume[91663]: WARNING cinder.quota [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-105663273 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-105663273, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Created reservations ['fff02340-982d-4d1a-888e-9c7a3ae4299c', '5113abc8-3711-4de5-974b-e0228d61cde4', 'b4739d8f-a6c1-4561-b23e-8799f699153d', '8a4f8d1b-8040-4183-b9fc-8e70b9e7e8fa'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:16 devstack sudo[102985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1
Jun 18 11:35:16 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:16 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_mi7fi67g" returned: 1 in 0.749s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_mi7fi67g' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76d0ca5-4358-4695-9584-0e1169ed060f]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] Created reservations ['a7108bd6-3f15-456a-af79-e0237d09f67a', '0779e79c-a437-48be-92e4-5f9c90b47511', '522575f8-1f38-4ff8-b0a7-4eb18789671d', '6076c73f-8390-4304-bf57-b6ffe1b855cd'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:16 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-5a7be6f7-af02-4968-a553-a5a8c8d4aabe tempest-GroupSnapshotsTest-1584421778 None] group_snapshot 52b74244-00a8-4180-a75e-b1eedbf5441c: deleted successfully
Jun 18 11:35:16 devstack sudo[102989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD
Jun 18 11:35:16 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:16 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6407b13f-cb5a-471b-9d54-b3a7c6a5a595" returned: 0 in 0.874s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] Lock "cinder-quobyte-6407b13f-cb5a-471b-9d54-b3a7c6a5a595" released by "delete_volume" :: held 1.785s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] Created reservations ['6a1cb25c-5cf4-4a53-afed-84098c63ae5b', 'bf9ab891-e80b-4454-a49b-494605e6190f', '67b1a52a-567a-4d37-a08a-1648d200c6cd', 'eda3b5bb-fcda-4b25-bc18-76f1f20f4321'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:16 devstack sudo[102992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:35:16 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:16 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2cc98a9b-8a82-42ea-9008-07932b3ab603 tempest-SnapshotsActionsTest-171500394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1" returned: 0 in 0.840s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2cc98a9b-8a82-42ea-9008-07932b3ab603 tempest-SnapshotsActionsTest-171500394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:35:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2cc98a9b-8a82-42ea-9008-07932b3ab603 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:16 devstack sudo[102997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d 1G
Jun 18 11:35:16 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:17 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD" returned: 0 in 0.919s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:17 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.760s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:17 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:35:17 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] Deleted volume successfully.
Jun 18 11:35:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-56545345-2b55-4a90-bda9-7fe3d0848a95 tempest-VolumesActionsTest-1234935443 None] Lock "cinder-6407b13f-cb5a-471b-9d54-b3a7c6a5a595-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:17 devstack sudo[103001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD
Jun 18 11:35:17 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "cinder-quobyte-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d" acquired by "delete_volume" :: waited 0.037s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:17 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e59ef4-3bd8-428f-9fad-c55a908cbcbb]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:17 devstack sudo[103004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d
Jun 18 11:35:17 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:18 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2cc98a9b-8a82-42ea-9008-07932b3ab603 tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d 1G" returned: 0 in 1.216s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2cc98a9b-8a82-42ea-9008-07932b3ab603 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:18 devstack sudo[103013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d
Jun 18 11:35:18 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:18 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD" returned: 1 in 1.048s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:35:18 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] 69f57b7e-486d-4eb2-8cd0-f98c0ed6b388 was raw, converting to raw {{(pid=91663) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 18 11:35:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:18 devstack sudo[103015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb
Jun 18 11:35:18 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:18 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d" returned: 0 in 1.049s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:18 devstack sudo[103021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d
Jun 18 11:35:18 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:19 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2cc98a9b-8a82-42ea-9008-07932b3ab603 tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d" returned: 0 in 0.881s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:19 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-2cc98a9b-8a82-42ea-9008-07932b3ab603 tempest-SnapshotsActionsTest-171500394 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d is being set with open permissions: ugo+rw
Jun 18 11:35:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2cc98a9b-8a82-42ea-9008-07932b3ab603 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:19 devstack sudo[103063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d
Jun 18 11:35:19 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:19 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb" returned: 0 in 1.183s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:19 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_69f57b7e-486d-4eb2-8cd0-f98c0ed6b388_cefglhyrdevstack@QuobyteHD, size 0.00 MB, duration 1.18 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:35:19 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Converted 0.00 MB image at 0.00 MB/s
Jun 18 11:35:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:19 devstack sudo[103070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb 1G
Jun 18 11:35:19 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:19 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d" returned: 0 in 0.829s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-b1503a99-caa9-4ac3-9c50-4697d3ddfe0d" released by "delete_volume" :: held 1.970s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "cinder-quobyte-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26" acquired by "delete_volume" :: waited 0.027s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:19 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc449469-476a-4df0-8b40-5933c36a628c]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:19 devstack sudo[103072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26
Jun 18 11:35:19 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:20 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2cc98a9b-8a82-42ea-9008-07932b3ab603 tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d" returned: 0 in 0.947s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2cc98a9b-8a82-42ea-9008-07932b3ab603 tempest-SnapshotsActionsTest-171500394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.004s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:20 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-2cc98a9b-8a82-42ea-9008-07932b3ab603 tempest-SnapshotsActionsTest-171500394 None] Create snapshot completed successfully
Jun 18 11:35:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Acquiring lock "cinder-15932505-7910-449a-8c01-6e2d6654eb8d-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-15932505-7910-449a-8c01-6e2d6654eb8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Acquiring lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Acquiring lock "cinder-quobyte-15932505-7910-449a-8c01-6e2d6654eb8d" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:20 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb 1G" returned: 0 in 1.117s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-quobyte-15932505-7910-449a-8c01-6e2d6654eb8d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:20 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Deleting offline snapshot 15932505-7910-449a-8c01-6e2d6654eb8d of volume b0376c92-75ab-4049-a1b9-f7d94e016bd6 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:35:20 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] snapshot_file for this snap is: volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:35:20 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f122507-3b1e-4c62-a9ba-f1f6402a27b8]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:20 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[50364619-94b9-4f89-a3d1-24cf58d5f890]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:20 devstack sudo[103082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb
Jun 18 11:35:20 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:20 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26" returned: 0 in 1.114s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:20 devstack sudo[103083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d
Jun 18 11:35:20 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:20 devstack sudo[103085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26
Jun 18 11:35:20 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:21 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26" returned: 0 in 0.805s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:21 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb" returned: 0 in 0.959s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-e65315e4-b45f-4a1c-ba45-2ae9b6cedd26" released by "delete_volume" :: held 2.009s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:21 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d" returned: 0 in 0.984s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:35:21 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fee9c6a-d720-40c8-add7-59ac512803f5]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:21 devstack sudo[103095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb
Jun 18 11:35:21 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:21 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Created reservations ['f1eb0b90-1d20-42e8-afca-f1b0f1d0be03'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:21 devstack cinder-volume[91663]: WARNING cinder.quota [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-105663273 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-105663273, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:35:21 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Created reservations ['4e1d3d57-3537-46a2-972d-c0b6624e92f9', '6990c94a-047a-4508-acec-c1b655f919fb', 'c78333f3-e753-432e-9884-1d3b7111400c', 'cdbeec45-7b72-4715-ba21-df95da4b138f'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:21 devstack sudo[103096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1
Jun 18 11:35:21 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:21 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Created reservations ['01d87a31-66e8-4202-a2aa-2db76c91130f', '83970f27-f20a-4fd3-9ad7-80417cfdc87f', '238b3d86-e238-408c-bfe6-a0ec3308335c', '182a1207-84e2-47d5-8d46-0a7354fc5753'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:22 devstack sudo[103099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:35:22 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:22 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb" returned: 1 in 0.927s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Downloaded image 69f57b7e-486d-4eb2-8cd0-f98c0ed6b388 ((None, [{'url': 'file:///opt/stack/data/glance/images/69f57b7e-486d-4eb2-8cd0-f98c0ed6b388', 'metadata': {}}])) to volume 07be3353-61c6-4444-ba53-6591fbf71dbb successfully. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Temporary image 69f57b7e-486d-4eb2-8cd0-f98c0ed6b388 for user 58fa62a038d5445ba5ea3b9e3881e03c is deleted. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Marking volume 07be3353-61c6-4444-ba53-6591fbf71dbb as bootable. {{(pid=91663) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Copying metadata from image 69f57b7e-486d-4eb2-8cd0-f98c0ed6b388 to 07be3353-61c6-4444-ba53-6591fbf71dbb. {{(pid=91663) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Creating volume glance metadata for volume 07be3353-61c6-4444-ba53-6591fbf71dbb backed by image 69f57b7e-486d-4eb2-8cd0-f98c0ed6b388 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '69f57b7e-486d-4eb2-8cd0-f98c0ed6b388', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f53eec0507d8f69f3f8effcd72eb5808', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=91663) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 18 11:35:22 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1" returned: 0 in 0.978s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:22 devstack sudo[103107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d
Jun 18 11:35:22 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9523082-3c6f-4bc7-bc97-65034745fb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07be3353-61c6-4444-ba53-6591fbf71dbb', 'volume_size': 1, 'image_id': '69f57b7e-486d-4eb2-8cd0-f98c0ed6b388', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69f57b7e-486d-4eb2-8cd0-f98c0ed6b388', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f53eec0507d8f69f3f8effcd72eb5808', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e3a6944a8c945b0b0ee0db3ae57a8cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2fcb1d2c363010025f32f76714f97fe3a9928382a63be76d3a96ad3ed7708a436c683dd4131d87ee1ff272c7bd44f280ece6d0e091159574fa9d1256bb486457', 'id': '69f57b7e-486d-4eb2-8cd0-f98c0ed6b388', 'created_at': datetime.datetime(2026, 6, 18, 9, 34, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 34, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69f57b7e-486d-4eb2-8cd0-f98c0ed6b388/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ff0fd42c0>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a2886a-a6fb-4d9d-a728-22cf448d1207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:22 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Volume volume-07be3353-61c6-4444-ba53-6591fbf71dbb (07be3353-61c6-4444-ba53-6591fbf71dbb): created successfully
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a2886a-a6fb-4d9d-a728-22cf448d1207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:22 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Flow 'volume_create_manager' (bcd83616-2029-4d54-a8e3-395b16afc9bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:35:22 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-c197e1f4-e09f-42a8-8345-5ab2e42bc742 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Created volume successfully.
Jun 18 11:35:23 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.961s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:23 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:35:23 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-8de917f8-4d74-45d3-b45f-c948ebeeffe6 tempest-GroupSnapshotsTest-1584421778 None] Delete group completed successfully.
Jun 18 11:35:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Acquiring lock "cinder-07be3353-61c6-4444-ba53-6591fbf71dbb-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Lock "cinder-07be3353-61c6-4444-ba53-6591fbf71dbb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Acquiring lock "cinder-quobyte-07be3353-61c6-4444-ba53-6591fbf71dbb" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:23 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-bd8fa1c1-d5f7-4e8d-a458-cdf176452182 tempest-GroupSnapshotsTest-1584421778 None] Group tempest-GroupSnapshotsTest-Group-130970528: creating
Jun 18 11:35:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Lock "cinder-quobyte-07be3353-61c6-4444-ba53-6591fbf71dbb" acquired by "delete_volume" :: waited 0.032s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:23 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-bd8fa1c1-d5f7-4e8d-a458-cdf176452182 tempest-GroupSnapshotsTest-1584421778 None] Group tempest-GroupSnapshotsTest-Group-130970528: created successfully
Jun 18 11:35:23 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-bd8fa1c1-d5f7-4e8d-a458-cdf176452182 tempest-GroupSnapshotsTest-1584421778 None] Create group completed successfully.
Jun 18 11:35:23 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df25b6a-b5a9-4865-8dfc-0062ab89226c]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:23 devstack sudo[103110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb
Jun 18 11:35:23 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:23 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d" returned: 0 in 1.068s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:23 devstack sudo[103117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d
Jun 18 11:35:23 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:24 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb" returned: 0 in 0.837s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:24 devstack sudo[103121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb
Jun 18 11:35:24 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:24 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.15932505-7910-449a-8c01-6e2d6654eb8d" returned: 0 in 0.756s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-quobyte-15932505-7910-449a-8c01-6e2d6654eb8d" released by "_delete_snapshot" :: held 3.947s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" released by "delete_snapshot" :: held 3.977s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:24 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Created reservations ['98a689a3-74ae-448b-8157-438bd88e9886', 'd52e80e7-d3e9-483b-8798-73ba1460c4f5', '77187f3f-8383-4b80-bca0-c303bb739bda', '355b727e-864a-4504-ac9b-eb632c8beeb0'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:24 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Delete snapshot completed successfully.
Jun 18 11:35:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d49e8b32-09ba-4aef-a689-a96a0029d3de tempest-SnapshotsActionsTest-1709662857 None] Lock "cinder-15932505-7910-449a-8c01-6e2d6654eb8d-delete_snapshot" released by "delete_snapshot" :: held 4.147s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Flow 'volume_create_manager' (24c90ce2-f1f8-47e9-a78e-9ac8f19589eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9cf499-18b0-413e-afcb-6e35d418c3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9cf499-18b0-413e-afcb-6e35d418c3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-890403290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0b86c5e0-21cf-46d5-a6e2-3cc590bb5da8,host='devstack@QuobyteHD#QuobyteHD',id=25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9957a7edc41b698ae63f06a2a4e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:35:25Z,use_quota=True,user_id='29840517423548ea9a20a8a4f84a5ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c4f1dd1-e2e4-495b-8c9a-2e86a9553ecb),volume_type_id=2c4f1dd1-e2e4-495b-8c9a-2e86a9553ecb)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3744c33f-e59c-4153-adcf-78034b71de92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3744c33f-e59c-4153-adcf-78034b71de92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aee758f-9b27-4a07-a87e-3ea034766dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aee758f-9b27-4a07-a87e-3ea034766dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32', 'volume_name': 'volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d334a90c-b018-4ae8-b4e2-893a8a8b91d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d334a90c-b018-4ae8-b4e2-893a8a8b91d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97e6461-33bd-4846-a8bd-7cb3024cda6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:25 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Volume 25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32', 'volume_size': 1}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0b86c5e0-21cf-46d5-a6e2-3cc590bb5da8,created_at=2026-06-18T09:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-890403290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0b86c5e0-21cf-46d5-a6e2-3cc590bb5da8,host='devstack@QuobyteHD#QuobyteHD',id=25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9957a7edc41b698ae63f06a2a4e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:35:25Z,use_quota=True,user_id='29840517423548ea9a20a8a4f84a5ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c4f1dd1-e2e4-495b-8c9a-2e86a9553ecb),volume_type_id=2c4f1dd1-e2e4-495b-8c9a-2e86a9553ecb)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Creating volume 25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:25 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:35:25 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb" returned: 1 in 1.146s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:25 devstack sudo[103127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32 1073741824
Jun 18 11:35:25 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:25 devstack sudo[103129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb
Jun 18 11:35:25 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:25 devstack sudo[103131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:35:25 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] Acquiring lock "cinder-12ce6b26-cae6-499b-8838-d25b938f52d1-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] Lock "cinder-12ce6b26-cae6-499b-8838-d25b938f52d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] Acquiring lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] Lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] Acquiring lock "cinder-quobyte-12ce6b26-cae6-499b-8838-d25b938f52d1" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] Lock "cinder-quobyte-12ce6b26-cae6-499b-8838-d25b938f52d1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] Deleting offline snapshot 12ce6b26-cae6-499b-8838-d25b938f52d1 of volume b0376c92-75ab-4049-a1b9-f7d94e016bd6 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] snapshot_file for this snap is: volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c746779-db6d-4dde-bd30-a98b42b1eac7]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:25 devstack sudo[103133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1
Jun 18 11:35:25 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:26 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-07be3353-61c6-4444-ba53-6591fbf71dbb" returned: 0 in 0.869s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Lock "cinder-quobyte-07be3353-61c6-4444-ba53-6591fbf71dbb" released by "delete_volume" :: held 2.950s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:26 devstack cinder-volume[91663]: WARNING cinder.quota [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:35:26 devstack cinder-volume[91663]: WARNING cinder.quota [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Created reservations ['d249777a-3953-4e26-b716-62c780431da7', '7fe3421a-2401-4155-b2cf-bc432ac9ab12', '89440aae-94cc-439e-9c61-fa307fa816de', '606a1f30-b873-4c4d-8aa9-122ae503958c'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:26 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.033s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:35:26 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32 1073741824" returned: 0 in 1.229s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:26 devstack sudo[103143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:35:26 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:26 devstack sudo[103144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32
Jun 18 11:35:26 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:26 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1" returned: 0 in 1.166s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[f096ec68-8c34-425f-89f6-e1d19ed7da9b]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:26 devstack sudo[103151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6
Jun 18 11:35:26 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:27 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.769s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:27 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:35:27 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Deleted volume successfully.
Jun 18 11:35:27 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:27 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-09442cfe-cca1-484d-bf17-a3472f867dd8 tempest-VolumeAndVolumeTypeFromImageTest-1428664731 None] Lock "cinder-07be3353-61c6-4444-ba53-6591fbf71dbb-delete_volume" released by "delete_volume" :: held 4.255s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32" returned: 0 in 0.778s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:27 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] <== create_volume: return (2113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:35:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.117s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97e6461-33bd-4846-a8bd-7cb3024cda6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01487f78-e8e3-46c3-bf39-8781c10c3a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:27 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Volume volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32 (25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32): created successfully
Jun 18 11:35:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01487f78-e8e3-46c3-bf39-8781c10c3a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Flow 'volume_create_manager' (24c90ce2-f1f8-47e9-a78e-9ac8f19589eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:35:27 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-b1132e90-390c-4e13-a4e5-20b19dc11511 tempest-GroupSnapshotsTest-1584421778 None] Created volume successfully.
Jun 18 11:35:27 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6" returned: 0 in 0.974s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:27 devstack sudo[103159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1
Jun 18 11:35:27 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:28 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] GroupSnapshot aedb9251-30e8-458e-a73a-e44ec96bdcf7: creating.
Jun 18 11:35:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] Group snapshot aedb9251-30e8-458e-a73a-e44ec96bdcf7: creating. {{(pid=91663) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 18 11:35:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] Creating offline snapshot c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc of volume 25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:35:28 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78692fa-1273-49a3-9e92-1f16156a1fc8]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:28 devstack sudo[103161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32
Jun 18 11:35:28 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:28 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1" returned: 0 in 1.002s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:28 devstack sudo[103166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1
Jun 18 11:35:28 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:29 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32" returned: 0 in 0.955s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:29 devstack sudo[103171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc 1G
Jun 18 11:35:29 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:29 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6.12ce6b26-cae6-499b-8838-d25b938f52d1" returned: 0 in 0.819s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:29 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] Lock "cinder-quobyte-12ce6b26-cae6-499b-8838-d25b938f52d1" released by "_delete_snapshot" :: held 4.130s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:29 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] Lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" released by "delete_snapshot" :: held 4.169s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:29 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] Created reservations ['b31809ea-e1f6-4149-ac23-f61dd4ef9ecb', '8e87444c-ce15-434d-8bd4-1b6e5de28b2a', '7e040af1-d055-4c92-b1e4-981f730db075', 'c46d9ee2-2ea7-4b96-b5f5-5f32ddee5bb5'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:29 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] Delete snapshot completed successfully.
Jun 18 11:35:29 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-03440048-cada-42e8-9fba-165a1f538058 tempest-SnapshotsActionsTest-171500394 None] Lock "cinder-12ce6b26-cae6-499b-8838-d25b938f52d1-delete_snapshot" released by "delete_snapshot" :: held 4.349s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:30 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc 1G" returned: 0 in 1.075s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:30 devstack sudo[103179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc
Jun 18 11:35:30 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:31 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] Acquiring lock "cinder-b0376c92-75ab-4049-a1b9-f7d94e016bd6-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:30 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc" returned: 0 in 0.776s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:31 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc is being set with open permissions: ugo+rw: NotImplementedError
Jun 18 11:35:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:31 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] Lock "cinder-b0376c92-75ab-4049-a1b9-f7d94e016bd6-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:31 devstack sudo[103184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc
Jun 18 11:35:31 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:31 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] Acquiring lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:31 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] Lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" acquired by "delete_volume" :: waited 0.032s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:31 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad39e64-b131-4003-9e6c-d1b02b73af24]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:31 devstack sudo[103186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6
Jun 18 11:35:31 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:31 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc" returned: 0 in 0.792s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:31 devstack sudo[103189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.info
Jun 18 11:35:31 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:32 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6" returned: 0 in 0.956s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:32 devstack sudo[103194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6
Jun 18 11:35:32 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:32 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.info" returned: 0 in 0.709s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:32 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 18 11:35:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:32 devstack sudo[103197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.info
Jun 18 11:35:32 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:32 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b0376c92-75ab-4049-a1b9-f7d94e016bd6" returned: 0 in 0.698s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] Lock "cinder-quobyte-b0376c92-75ab-4049-a1b9-f7d94e016bd6" released by "delete_volume" :: held 1.757s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:33 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] Created reservations ['ac533403-f8da-4d0e-925e-96a46ba56c71', '8ded1c44-b31f-4631-9fc5-fb08b347fac3', '7c52be7e-7720-4496-ae7e-da90bc1b6043', 'b0fd4c70-b323-4656-a882-ce92638cf73a'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:33 devstack sudo[103200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:35:33 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:33 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.info" returned: 0 in 0.766s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.186s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:33 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-0b2a3f94-e348-4c58-b263-04ba93521952 tempest-GroupSnapshotsTest-1584421778 None] group_snapshot aedb9251-30e8-458e-a73a-e44ec96bdcf7: created successfully
Jun 18 11:35:33 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.823s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:33 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:35:33 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] Deleted volume successfully.
Jun 18 11:35:33 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-99906488-8224-4d8e-a42b-32935a71027b tempest-SnapshotsActionsTest-171500394 None] Lock "cinder-b0376c92-75ab-4049-a1b9-f7d94e016bd6-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:34 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] group_snapshot aedb9251-30e8-458e-a73a-e44ec96bdcf7: deleting
Jun 18 11:35:34 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] group_snapshot aedb9251-30e8-458e-a73a-e44ec96bdcf7: deleting {{(pid=91663) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 18 11:35:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "cinder-quobyte-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "cinder-quobyte-c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:34 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] Deleting offline snapshot c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc of volume 25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:35:34 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] snapshot_file for this snap is: volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:35:34 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[786dbac3-7eae-4bb3-824f-78df5bee2a90]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:34 devstack sudo[103204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc
Jun 18 11:35:34 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:35 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc" returned: 0 in 0.842s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:35 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:35:35 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b390c6-c887-497d-8290-6024d77f64f2]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:35 devstack sudo[103209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32
Jun 18 11:35:35 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:36 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32" returned: 0 in 0.845s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:36 devstack sudo[103214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc
Jun 18 11:35:36 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:37 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc" returned: 0 in 0.764s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:37 devstack sudo[103220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc
Jun 18 11:35:37 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:38 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32.c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc" returned: 0 in 0.696s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-c7a3a878-ac73-4fe5-8ab7-1ed6e0f247fc" released by "_delete_snapshot" :: held 3.283s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32" released by "delete_snapshot" :: held 3.316s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:INSERT=57,cinder:UPDATE=178,cinder:SELECT=151,cinder:DELETE=14 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Flow 'volume_create_manager' (46425d52-4f7d-4d31-9bda-dbd74414bb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3bdb05-7f6c-4c46-8622-c20b5a2a6025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3bdb05-7f6c-4c46-8622-c20b5a2a6025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1762286126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a59565-ccea-41c3-ba20-567bfa742723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834f442ba49544ea8fd0c6b3b0c81a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:35:38Z,use_quota=True,user_id='926656d1bd81413b9eee4f00931fb80c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abd7061-3f60-4bad-b2dc-84daa042382b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abd7061-3f60-4bad-b2dc-84daa042382b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac002808-b321-4c64-ae3b-5a7df1e2694e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac002808-b321-4c64-ae3b-5a7df1e2694e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53a59565-ccea-41c3-ba20-567bfa742723', 'volume_name': 'volume-53a59565-ccea-41c3-ba20-567bfa742723', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0fb45b-436b-44f8-9a31-15218cba04cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0fb45b-436b-44f8-9a31-15218cba04cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6debc3-eee0-41c6-8049-27d791905f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:38 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Volume 53a59565-ccea-41c3-ba20-567bfa742723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53a59565-ccea-41c3-ba20-567bfa742723', 'volume_size': 1}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1762286126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a59565-ccea-41c3-ba20-567bfa742723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834f442ba49544ea8fd0c6b3b0c81a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:35:38Z,use_quota=True,user_id='926656d1bd81413b9eee4f00931fb80c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Creating volume 53a59565-ccea-41c3-ba20-567bfa742723 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:35:38 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-53a59565-ccea-41c3-ba20-567bfa742723 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:38 devstack sudo[103223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-53a59565-ccea-41c3-ba20-567bfa742723 1073741824
Jun 18 11:35:38 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:38 devstack cinder-volume[91663]: WARNING cinder.quota [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-567499976 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-567499976, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:35:38 devstack cinder-volume[91663]: WARNING cinder.quota [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-567499976 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-567499976, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:35:38 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] Created reservations ['07ad1e3f-4e94-4050-9dc3-35eea967a808', '28a1ca95-fddf-417f-a05c-71d68d4e17ee', 'e2f936e5-00c7-4e46-8d87-23fae77bdede', 'f5f945fc-5b37-4654-a52f-36455843cb85'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:38 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-09cb2055-d878-4d35-9ab8-037f040b21bc tempest-GroupSnapshotsTest-1584421778 None] group_snapshot aedb9251-30e8-458e-a73a-e44ec96bdcf7: deleted successfully
Jun 18 11:35:39 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-53a59565-ccea-41c3-ba20-567bfa742723 1073741824" returned: 0 in 0.895s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-53a59565-ccea-41c3-ba20-567bfa742723 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:39 devstack sudo[103229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-53a59565-ccea-41c3-ba20-567bfa742723
Jun 18 11:35:39 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:39 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "cinder-quobyte-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:39 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32" acquired by "delete_volume" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:39 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dd1b19-78f2-4b28-81b1-eaa69b4fbfeb]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:39 devstack sudo[103232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32
Jun 18 11:35:39 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:39 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-53a59565-ccea-41c3-ba20-567bfa742723" returned: 0 in 0.662s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:39 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:35:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6debc3-eee0-41c6-8049-27d791905f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53a59565-ccea-41c3-ba20-567bfa742723', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b974ae4-cd46-489c-9e3e-f414493a5c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:39 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Volume volume-53a59565-ccea-41c3-ba20-567bfa742723 (53a59565-ccea-41c3-ba20-567bfa742723): created successfully
Jun 18 11:35:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b974ae4-cd46-489c-9e3e-f414493a5c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Flow 'volume_create_manager' (46425d52-4f7d-4d31-9bda-dbd74414bb49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:35:39 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-fa7de7dc-ebe5-491a-b4f9-075f35a9fbbf tempest-VolumesTransfersV355Test-902068970 None] Created volume successfully.
Jun 18 11:35:40 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32" returned: 0 in 0.833s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:40 devstack sudo[103238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32
Jun 18 11:35:40 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:40 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-07ae9312-e1e8-4c02-9f32-2ad096e0207a tempest-VolumesTransfersV355Test-1063210333 None] Transfer volume completed successfully.
Jun 18 11:35:41 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32" returned: 0 in 0.684s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] Lock "cinder-quobyte-25e2ee8d-b1cb-43b2-bae9-2e40c24f7f32" released by "delete_volume" :: held 1.594s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=158,cinder:UPDATE=170,cinder:INSERT=41,cinder:DELETE=7 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] Created reservations ['f3d2dc3f-335c-4286-a5fe-2a4eaf5b1914'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:41 devstack cinder-volume[91663]: WARNING cinder.quota [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-567499976 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-567499976, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] Created reservations ['d6e2b026-c906-49ee-8e80-caf279006701', 'c649450d-d3cb-49b1-ae65-0b41684b3238', 'b8f8643b-b09b-4499-a7e7-d1b6f2072ec3', '4244da3c-546b-40c7-a66b-415c24ac6020'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:41 devstack sudo[103241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:35:41 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] Acquiring lock "cinder-53a59565-ccea-41c3-ba20-567bfa742723-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] Lock "cinder-53a59565-ccea-41c3-ba20-567bfa742723-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] Acquiring lock "cinder-quobyte-53a59565-ccea-41c3-ba20-567bfa742723" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] Lock "cinder-quobyte-53a59565-ccea-41c3-ba20-567bfa742723" acquired by "delete_volume" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:41 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.672s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:35:41 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-2dff44dd-c6d0-4108-aac5-39394b9f9ea9 tempest-GroupSnapshotsTest-1584421778 None] Delete group completed successfully.
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d352ff-8fd9-4657-98e1-ea8cc9a3c379]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-53a59565-ccea-41c3-ba20-567bfa742723 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:42 devstack sudo[103244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-53a59565-ccea-41c3-ba20-567bfa742723
Jun 18 11:35:42 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:42 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-53a59565-ccea-41c3-ba20-567bfa742723" returned: 0 in 0.868s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-53a59565-ccea-41c3-ba20-567bfa742723 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:42 devstack sudo[103249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-53a59565-ccea-41c3-ba20-567bfa742723
Jun 18 11:35:42 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:43 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-53a59565-ccea-41c3-ba20-567bfa742723" returned: 0 in 0.776s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:43 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] Lock "cinder-quobyte-53a59565-ccea-41c3-ba20-567bfa742723" released by "delete_volume" :: held 1.699s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:43 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] Created reservations ['091ea2ec-e3bc-4af3-81da-0e4025aa4c42', '96c4d718-a84b-4093-b76a-8933b11be22b', 'c5d2f768-3136-4664-8019-7cecc745e4a1', 'f9b133d6-aaf9-470a-96bc-a455e72efcef'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:43 devstack sudo[103252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:35:43 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:44 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.855s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:44 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:35:44 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] Deleted volume successfully.
Jun 18 11:35:44 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e3ec7ff1-a30d-4a71-be8c-b0cb46ee5b69 tempest-VolumesTransfersV355Test-1462992713 None] Lock "cinder-53a59565-ccea-41c3-ba20-567bfa742723-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:44 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:35:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Flow 'volume_create_manager' (6f387f03-5700-496b-964f-904334f3b63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:35:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e0d6a8-aa56-4069-b1f6-7c446f3b6be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e0d6a8-aa56-4069-b1f6-7c446f3b6be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1376735080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b052b23-bad6-419f-88c8-f6cee32d2759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834f442ba49544ea8fd0c6b3b0c81a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:35:45Z,use_quota=True,user_id='926656d1bd81413b9eee4f00931fb80c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897c2070-c280-4d65-857e-54e4d1412a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897c2070-c280-4d65-857e-54e4d1412a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2d2f7e-1996-4aaa-ad3b-b06fa219ca42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2d2f7e-1996-4aaa-ad3b-b06fa219ca42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b052b23-bad6-419f-88c8-f6cee32d2759', 'volume_name': 'volume-8b052b23-bad6-419f-88c8-f6cee32d2759', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d081c04-c44a-4787-bd0c-d15c52ef3589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d081c04-c44a-4787-bd0c-d15c52ef3589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509c2c36-9365-4bc7-ab5a-7ffdfcd477b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:45 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Volume 8b052b23-bad6-419f-88c8-f6cee32d2759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b052b23-bad6-419f-88c8-f6cee32d2759', 'volume_size': 1}
Jun 18 11:35:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1376735080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b052b23-bad6-419f-88c8-f6cee32d2759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834f442ba49544ea8fd0c6b3b0c81a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:35:45Z,use_quota=True,user_id='926656d1bd81413b9eee4f00931fb80c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:35:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Creating volume 8b052b23-bad6-419f-88c8-f6cee32d2759 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:35:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:35:45 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:35:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8b052b23-bad6-419f-88c8-f6cee32d2759 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:45 devstack sudo[103256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8b052b23-bad6-419f-88c8-f6cee32d2759 1073741824
Jun 18 11:35:45 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:46 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8b052b23-bad6-419f-88c8-f6cee32d2759 1073741824" returned: 0 in 1.014s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8b052b23-bad6-419f-88c8-f6cee32d2759 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:46 devstack sudo[103262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8b052b23-bad6-419f-88c8-f6cee32d2759
Jun 18 11:35:46 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:46 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8b052b23-bad6-419f-88c8-f6cee32d2759" returned: 0 in 0.669s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:35:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509c2c36-9365-4bc7-ab5a-7ffdfcd477b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b052b23-bad6-419f-88c8-f6cee32d2759', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a2e8f5-22e9-4c3d-81b8-9abaa101ee80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:46 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Volume volume-8b052b23-bad6-419f-88c8-f6cee32d2759 (8b052b23-bad6-419f-88c8-f6cee32d2759): created successfully
Jun 18 11:35:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a2e8f5-22e9-4c3d-81b8-9abaa101ee80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Flow 'volume_create_manager' (6f387f03-5700-496b-964f-904334f3b63c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:35:46 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-74d13b6b-69f4-41d5-ba69-4859b260a51a tempest-VolumesTransfersV355Test-902068970 None] Created volume successfully.
Jun 18 11:35:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] Acquiring lock "cinder-8b052b23-bad6-419f-88c8-f6cee32d2759-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] Lock "cinder-8b052b23-bad6-419f-88c8-f6cee32d2759-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] Acquiring lock "cinder-quobyte-8b052b23-bad6-419f-88c8-f6cee32d2759" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] Lock "cinder-quobyte-8b052b23-bad6-419f-88c8-f6cee32d2759" acquired by "delete_volume" :: waited 0.023s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:47 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f9bd14-d464-4a32-ba8d-62ac8dcb3b76]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8b052b23-bad6-419f-88c8-f6cee32d2759 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:47 devstack sudo[103265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8b052b23-bad6-419f-88c8-f6cee32d2759
Jun 18 11:35:47 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:48 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8b052b23-bad6-419f-88c8-f6cee32d2759" returned: 0 in 0.819s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8b052b23-bad6-419f-88c8-f6cee32d2759 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:48 devstack sudo[103270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8b052b23-bad6-419f-88c8-f6cee32d2759
Jun 18 11:35:48 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:48 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-57bca7e6-4886-43b8-a531-a399e79a5b55 tempest-GroupsV320Test-224954428 None] Group tempest-GroupsV320Test-Group-1896954871: creating
Jun 18 11:35:48 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-57bca7e6-4886-43b8-a531-a399e79a5b55 tempest-GroupsV320Test-224954428 None] Group tempest-GroupsV320Test-Group-1896954871: created successfully
Jun 18 11:35:48 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-57bca7e6-4886-43b8-a531-a399e79a5b55 tempest-GroupsV320Test-224954428 None] Create group completed successfully.
Jun 18 11:35:49 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8b052b23-bad6-419f-88c8-f6cee32d2759" returned: 0 in 0.727s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] Lock "cinder-quobyte-8b052b23-bad6-419f-88c8-f6cee32d2759" released by "delete_volume" :: held 1.594s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] Created reservations ['d526f1bc-3e5f-43cf-b730-0ec275e0cdfb', 'e254cc22-96f4-40cd-8508-a268694b80a7', 'e6a2cd75-00af-4326-8772-96cb7295a993', 'f5369c77-8583-4e58-8c2d-919c17f3f8bb'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Flow 'volume_create_manager' (29f53e41-2d1f-499a-92df-945b755299bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ebf9cd1-a173-425b-b1ad-12e32fa79cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ebf9cd1-a173-425b-b1ad-12e32fa79cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1231920363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9123a54538714dbea01ffe8942b2b971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:35:49Z,use_quota=True,user_id='8c2b8d7841364c33877321b501323332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7421ea0-3e07-43d0-b73a-c13a57f5ce96),volume_type_id=b7421ea0-3e07-43d0-b73a-c13a57f5ce96)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c869aaaf-1805-4bf2-95a9-a139274921dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c869aaaf-1805-4bf2-95a9-a139274921dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad97d6d9-527c-4188-8a5f-71b5a9fd106d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad97d6d9-527c-4188-8a5f-71b5a9fd106d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6', 'volume_name': 'volume-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce8d4ce1-ecc6-441f-ac37-80f9da1c7fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce8d4ce1-ecc6-441f-ac37-80f9da1c7fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55de0743-32ea-4003-95cf-e11b654fd8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:49 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Volume 503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6', 'volume_size': 1}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1231920363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9123a54538714dbea01ffe8942b2b971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:35:49Z,use_quota=True,user_id='8c2b8d7841364c33877321b501323332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7421ea0-3e07-43d0-b73a-c13a57f5ce96),volume_type_id=b7421ea0-3e07-43d0-b73a-c13a57f5ce96)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Creating volume 503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:35:49 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:49 devstack sudo[103273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6 1073741824
Jun 18 11:35:49 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:49 devstack sudo[103275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:35:49 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:49 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.692s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:35:49 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] Deleted volume successfully.
Jun 18 11:35:49 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-73085b96-581d-4d3b-93d9-501ec7342ff6 tempest-VolumesTransfersV355Test-1462992713 None] Lock "cinder-8b052b23-bad6-419f-88c8-f6cee32d2759-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:50 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6 1073741824" returned: 0 in 0.966s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:50 devstack sudo[103283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6
Jun 18 11:35:50 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:50 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-450c8274-8ba6-4676-8ad3-b6e5f828eb96 tempest-GroupsV320Test-224954428 None] Created reservations ['ebcf88fe-e799-4c67-9f79-62f535c5730c'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-450c8274-8ba6-4676-8ad3-b6e5f828eb96 tempest-GroupsV320Test-224954428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-450c8274-8ba6-4676-8ad3-b6e5f828eb96 tempest-GroupsV320Test-224954428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-450c8274-8ba6-4676-8ad3-b6e5f828eb96 tempest-GroupsV320Test-224954428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-450c8274-8ba6-4676-8ad3-b6e5f828eb96 tempest-GroupsV320Test-224954428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-450c8274-8ba6-4676-8ad3-b6e5f828eb96 tempest-GroupsV320Test-224954428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-450c8274-8ba6-4676-8ad3-b6e5f828eb96 tempest-GroupsV320Test-224954428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:50 devstack sudo[103285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:35:50 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:50 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6" returned: 0 in 0.695s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:35:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55de0743-32ea-4003-95cf-e11b654fd8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ad3933-0aa2-411f-b2be-54699de4ca1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:50 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Volume volume-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6 (503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6): created successfully
Jun 18 11:35:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ad3933-0aa2-411f-b2be-54699de4ca1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Flow 'volume_create_manager' (29f53e41-2d1f-499a-92df-945b755299bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:35:50 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-5948ad1a-3e1d-41c3-b7a3-24410aeaeda2 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Created volume successfully.
Jun 18 11:35:51 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-450c8274-8ba6-4676-8ad3-b6e5f828eb96 tempest-GroupsV320Test-224954428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.665s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:51 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-450c8274-8ba6-4676-8ad3-b6e5f828eb96 tempest-GroupsV320Test-224954428 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:35:51 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-450c8274-8ba6-4676-8ad3-b6e5f828eb96 tempest-GroupsV320Test-224954428 None] Delete group completed successfully.
Jun 18 11:35:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-afdc866f-dc89-42c5-9f17-5f67b07ff9d0 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-afdc866f-dc89-42c5-9f17-5f67b07ff9d0 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:51 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-afdc866f-dc89-42c5-9f17-5f67b07ff9d0 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:51 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-afdc866f-dc89-42c5-9f17-5f67b07ff9d0 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-afdc866f-dc89-42c5-9f17-5f67b07ff9d0 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-afdc866f-dc89-42c5-9f17-5f67b07ff9d0 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:51 devstack sudo[103289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:35:51 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:52 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-afdc866f-dc89-42c5-9f17-5f67b07ff9d0 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.752s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:52 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-afdc866f-dc89-42c5-9f17-5f67b07ff9d0 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:35:52 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-afdc866f-dc89-42c5-9f17-5f67b07ff9d0 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Retype volume completed successfully.
Jun 18 11:35:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Acquiring lock "cinder-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Lock "cinder-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Acquiring lock "cinder-quobyte-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:35:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Lock "cinder-quobyte-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6" acquired by "delete_volume" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:35:53 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ac43ce-4f35-4366-bdfa-55ca34ee6765]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:35:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:53 devstack sudo[103292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6
Jun 18 11:35:53 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:53 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6" returned: 0 in 0.938s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:54 devstack sudo[103297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6
Jun 18 11:35:54 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:54 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6" returned: 0 in 0.774s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Lock "cinder-quobyte-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6" released by "delete_volume" :: held 1.762s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:54 devstack cinder-volume[91663]: WARNING cinder.quota [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:35:54 devstack cinder-volume[91663]: WARNING cinder.quota [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:35:54 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Created reservations ['0243e530-6fc7-4a0e-b51d-78eab6f5a9ca', 'dfd95964-6ace-4966-a5b4-0224b5f4e06a', '1883f972-8ce5-4925-b31a-b452931ff25e', 'a1ce8da7-4f0e-451b-b2d8-7af306437380'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:35:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:54 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:54 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:54 devstack sudo[103300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:35:54 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:55 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.706s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:55 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:35:55 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Deleted volume successfully.
Jun 18 11:35:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6148a5e8-b4e2-4ec7-88bf-e23edc806dd4 tempest-VolumeRetypeWithoutMigrationTest-1106956024 None] Lock "cinder-503c0fe1-ef8d-4ad7-89fb-a2cecca4d4f6-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Flow 'volume_create_manager' (a3947cc9-ab6c-4a1a-9762-9282e300d777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0303cd2-9b33-4f99-860f-f9d928e6ea3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0303cd2-9b33-4f99-860f-f9d928e6ea3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-981649570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6c7266-707d-4bbd-84ea-669035db5bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1409e47a8a674205876341e20d71c2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:35:58Z,use_quota=True,user_id='daf8d7bbb9444b2ab6b2f2fefd58c72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b6f0ac-0c43-432e-b2aa-173f25da1b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b6f0ac-0c43-432e-b2aa-173f25da1b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a485d2db-669c-4df8-b0bf-790476034508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a485d2db-669c-4df8-b0bf-790476034508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb6c7266-707d-4bbd-84ea-669035db5bd8', 'volume_name': 'volume-bb6c7266-707d-4bbd-84ea-669035db5bd8', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5828103c-21c4-4491-bcc4-18c56da52beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5828103c-21c4-4491-bcc4-18c56da52beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfe6295-d365-4bd6-b41c-52897a601edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:35:58 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Volume bb6c7266-707d-4bbd-84ea-669035db5bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb6c7266-707d-4bbd-84ea-669035db5bd8', 'volume_size': 1}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-981649570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6c7266-707d-4bbd-84ea-669035db5bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1409e47a8a674205876341e20d71c2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:35:58Z,use_quota=True,user_id='daf8d7bbb9444b2ab6b2f2fefd58c72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Creating volume bb6c7266-707d-4bbd-84ea-669035db5bd8 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:35:58 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:35:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bb6c7266-707d-4bbd-84ea-669035db5bd8 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:58 devstack sudo[103306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bb6c7266-707d-4bbd-84ea-669035db5bd8 1073741824
Jun 18 11:35:58 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:35:59 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root
Jun 18 11:35:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bb6c7266-707d-4bbd-84ea-669035db5bd8 1073741824" returned: 0 in 0.966s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:35:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bb6c7266-707d-4bbd-84ea-669035db5bd8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:35:59 devstack sudo[103313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bb6c7266-707d-4bbd-84ea-669035db5bd8
Jun 18 11:35:59 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:00 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bb6c7266-707d-4bbd-84ea-669035db5bd8" returned: 0 in 0.677s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:36:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfe6295-d365-4bd6-b41c-52897a601edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb6c7266-707d-4bbd-84ea-669035db5bd8', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdf4f42-86cd-445b-adbd-7a42e32a337b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:00 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Volume volume-bb6c7266-707d-4bbd-84ea-669035db5bd8 (bb6c7266-707d-4bbd-84ea-669035db5bd8): created successfully
Jun 18 11:36:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdf4f42-86cd-445b-adbd-7a42e32a337b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Flow 'volume_create_manager' (a3947cc9-ab6c-4a1a-9762-9282e300d777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:00 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-211378ec-3883-4b93-bb19-f7b594673163 tempest-VolumesTransfersV357Test-769754008 None] Created volume successfully.
Jun 18 11:36:01 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-e2de6e45-9f80-43fc-bf2e-d68690f662d1 tempest-VolumesTransfersV357Test-1792488326 None] Transfer volume completed successfully.
Jun 18 11:36:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] Acquiring lock "cinder-bb6c7266-707d-4bbd-84ea-669035db5bd8-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] Lock "cinder-bb6c7266-707d-4bbd-84ea-669035db5bd8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] Acquiring lock "cinder-quobyte-bb6c7266-707d-4bbd-84ea-669035db5bd8" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] Lock "cinder-quobyte-bb6c7266-707d-4bbd-84ea-669035db5bd8" acquired by "delete_volume" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:02 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0835ea4-5428-45ff-b17f-dfa73660b280]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bb6c7266-707d-4bbd-84ea-669035db5bd8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:02 devstack sudo[103318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bb6c7266-707d-4bbd-84ea-669035db5bd8
Jun 18 11:36:02 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bb6c7266-707d-4bbd-84ea-669035db5bd8" returned: 0 in 0.879s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:03 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bb6c7266-707d-4bbd-84ea-669035db5bd8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:03 devstack sudo[103325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bb6c7266-707d-4bbd-84ea-669035db5bd8
Jun 18 11:36:03 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:04 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-bb6c7266-707d-4bbd-84ea-669035db5bd8" returned: 0 in 0.763s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:04 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] Lock "cinder-quobyte-bb6c7266-707d-4bbd-84ea-669035db5bd8" released by "delete_volume" :: held 1.703s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:04 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] Created reservations ['5191f99c-a859-4e44-b351-5859ab69bdc5', 'ccece022-48fc-4b33-9e93-40e408dc8a09', 'e5236cab-a3a2-489a-85da-39d480ec5488', 'db744487-573d-4100-b538-809d6b70a476'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:36:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:04 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:04 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:04 devstack sudo[103328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:36:04 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:05 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.861s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:36:05 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] Deleted volume successfully.
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7b8e6678-ec9a-4800-a2a2-66ff68b1b255 tempest-VolumesTransfersV357Test-1648024716 None] Lock "cinder-bb6c7266-707d-4bbd-84ea-669035db5bd8-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Flow 'volume_create_manager' (0e205d0d-2d22-400c-b6de-1c0b4529db1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c38edee-8f5f-4ce4-8b9f-4c5bb6e0eb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c38edee-8f5f-4ce4-8b9f-4c5bb6e0eb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2030077652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df380f34-673a-4c67-9ebf-82fa830d49d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1409e47a8a674205876341e20d71c2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:05Z,use_quota=True,user_id='daf8d7bbb9444b2ab6b2f2fefd58c72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0344b7de-9f4a-450f-aac2-1ba7cd64ad39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0344b7de-9f4a-450f-aac2-1ba7cd64ad39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ec3a46-ea6b-4b7b-b17e-4279b97b0a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ec3a46-ea6b-4b7b-b17e-4279b97b0a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df380f34-673a-4c67-9ebf-82fa830d49d8', 'volume_name': 'volume-df380f34-673a-4c67-9ebf-82fa830d49d8', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc4035d-a0fe-4003-82e1-75f73d86b4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc4035d-a0fe-4003-82e1-75f73d86b4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517804d7-f7b0-4b4f-b9df-4e5f1c4a7931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:05 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Volume df380f34-673a-4c67-9ebf-82fa830d49d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df380f34-673a-4c67-9ebf-82fa830d49d8', 'volume_size': 1}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2030077652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df380f34-673a-4c67-9ebf-82fa830d49d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1409e47a8a674205876341e20d71c2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:05Z,use_quota=True,user_id='daf8d7bbb9444b2ab6b2f2fefd58c72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Creating volume df380f34-673a-4c67-9ebf-82fa830d49d8 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:36:05 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:36:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-df380f34-673a-4c67-9ebf-82fa830d49d8 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:05 devstack sudo[103332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-df380f34-673a-4c67-9ebf-82fa830d49d8 1073741824
Jun 18 11:36:05 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:06 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-df380f34-673a-4c67-9ebf-82fa830d49d8 1073741824" returned: 0 in 0.972s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-df380f34-673a-4c67-9ebf-82fa830d49d8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:06 devstack sudo[103343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-df380f34-673a-4c67-9ebf-82fa830d49d8
Jun 18 11:36:06 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Flow 'volume_create_manager' (dbd91f12-9aa1-4d44-b1e6-1d4ee6d33fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4d179c-e70c-4754-8a46-fdeb9f4e5360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4d179c-e70c-4754-8a46-fdeb9f4e5360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2057469749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb85414-8972-435c-8218-cf8cedd9475d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69261e77d6d14fe4bf1724a9caf8f74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:07Z,use_quota=True,user_id='383dfcd3d4b742c6b51048c03db1ef81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2ddbad-76c0-4e56-9e07-60fd178e6a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2ddbad-76c0-4e56-9e07-60fd178e6a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:07 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae4c6cd-1498-4779-a54b-ecf57c86cea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae4c6cd-1498-4779-a54b-ecf57c86cea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb85414-8972-435c-8218-cf8cedd9475d', 'volume_name': 'volume-0cb85414-8972-435c-8218-cf8cedd9475d', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2514e79e-f527-453e-bea5-7cdf9c647dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2514e79e-f527-453e-bea5-7cdf9c647dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac5308f-5f85-418d-9069-6d1f48540a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:07 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Volume 0cb85414-8972-435c-8218-cf8cedd9475d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb85414-8972-435c-8218-cf8cedd9475d', 'volume_size': 1}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-df380f34-673a-4c67-9ebf-82fa830d49d8" returned: 0 in 0.767s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2057469749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb85414-8972-435c-8218-cf8cedd9475d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69261e77d6d14fe4bf1724a9caf8f74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:07Z,use_quota=True,user_id='383dfcd3d4b742c6b51048c03db1ef81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Creating volume 0cb85414-8972-435c-8218-cf8cedd9475d {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:36:07 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0cb85414-8972-435c-8218-cf8cedd9475d 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517804d7-f7b0-4b4f-b9df-4e5f1c4a7931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df380f34-673a-4c67-9ebf-82fa830d49d8', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:07 devstack sudo[103346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0cb85414-8972-435c-8218-cf8cedd9475d 1073741824
Jun 18 11:36:07 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e42091-6c65-4c91-8af1-c36ba9d0a418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:07 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Volume volume-df380f34-673a-4c67-9ebf-82fa830d49d8 (df380f34-673a-4c67-9ebf-82fa830d49d8): created successfully
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e42091-6c65-4c91-8af1-c36ba9d0a418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Flow 'volume_create_manager' (0e205d0d-2d22-400c-b6de-1c0b4529db1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:07 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-e32137ee-2810-4275-b709-9d6043333a86 tempest-VolumesTransfersV357Test-769754008 None] Created volume successfully.
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] Acquiring lock "cinder-df380f34-673a-4c67-9ebf-82fa830d49d8-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] Lock "cinder-df380f34-673a-4c67-9ebf-82fa830d49d8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] Acquiring lock "cinder-quobyte-df380f34-673a-4c67-9ebf-82fa830d49d8" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] Lock "cinder-quobyte-df380f34-673a-4c67-9ebf-82fa830d49d8" acquired by "delete_volume" :: waited 0.018s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:08 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cf2c5b-31bf-46a7-a12f-e5a17dfcc6b7]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-df380f34-673a-4c67-9ebf-82fa830d49d8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:08 devstack sudo[103351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-df380f34-673a-4c67-9ebf-82fa830d49d8
Jun 18 11:36:08 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:08 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0cb85414-8972-435c-8218-cf8cedd9475d 1073741824" returned: 0 in 0.907s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0cb85414-8972-435c-8218-cf8cedd9475d {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:08 devstack sudo[103354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0cb85414-8972-435c-8218-cf8cedd9475d
Jun 18 11:36:08 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:08 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-df380f34-673a-4c67-9ebf-82fa830d49d8" returned: 0 in 0.819s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-df380f34-673a-4c67-9ebf-82fa830d49d8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:08 devstack sudo[103359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-df380f34-673a-4c67-9ebf-82fa830d49d8
Jun 18 11:36:08 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:09 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0cb85414-8972-435c-8218-cf8cedd9475d" returned: 0 in 0.717s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac5308f-5f85-418d-9069-6d1f48540a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb85414-8972-435c-8218-cf8cedd9475d', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8eeab98-03d4-4697-9d9d-bc58e64a7938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:09 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Volume volume-0cb85414-8972-435c-8218-cf8cedd9475d (0cb85414-8972-435c-8218-cf8cedd9475d): created successfully
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8eeab98-03d4-4697-9d9d-bc58e64a7938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Flow 'volume_create_manager' (dbd91f12-9aa1-4d44-b1e6-1d4ee6d33fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:09 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-3fe933c1-a0b6-4f3d-a50a-7148700fba3a tempest-VolumeQuotasAdminTestJSON-73977799 None] Created volume successfully.
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Flow 'volume_create_manager' (0d93c2e1-485a-42f1-a163-938f645781dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ac2799-13a5-44fa-bc55-242e9aa6de66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ac2799-13a5-44fa-bc55-242e9aa6de66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-999508340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1347cc53-66e0-4022-84f0-6fb4ee124802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69d65946fd241baa0a554165dbf8c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:09Z,use_quota=True,user_id='3814b24e4be14f92979a17303797d8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c8ee24-2b79-47ee-9b85-007b24d04968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c8ee24-2b79-47ee-9b85-007b24d04968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9a17c2-7d75-4203-9f48-eba95383e858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9a17c2-7d75-4203-9f48-eba95383e858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1347cc53-66e0-4022-84f0-6fb4ee124802', 'volume_name': 'volume-1347cc53-66e0-4022-84f0-6fb4ee124802', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8186d0-c1d2-4daf-993a-3e2f61668196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8186d0-c1d2-4daf-993a-3e2f61668196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bfb64a9-d94a-4d2c-b43c-8eecd5f57389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:09 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Volume 1347cc53-66e0-4022-84f0-6fb4ee124802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1347cc53-66e0-4022-84f0-6fb4ee124802', 'volume_size': 1}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-999508340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1347cc53-66e0-4022-84f0-6fb4ee124802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69d65946fd241baa0a554165dbf8c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:09Z,use_quota=True,user_id='3814b24e4be14f92979a17303797d8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Creating volume 1347cc53-66e0-4022-84f0-6fb4ee124802 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:36:09 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:09 devstack sudo[103362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802 1073741824
Jun 18 11:36:09 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] Acquiring lock "cinder-0cb85414-8972-435c-8218-cf8cedd9475d-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] Lock "cinder-0cb85414-8972-435c-8218-cf8cedd9475d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] Acquiring lock "cinder-quobyte-0cb85414-8972-435c-8218-cf8cedd9475d" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] Lock "cinder-quobyte-0cb85414-8972-435c-8218-cf8cedd9475d" acquired by "delete_volume" :: waited 0.025s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e44333f-3fe7-4548-ae83-cb8ac04748c7]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0cb85414-8972-435c-8218-cf8cedd9475d {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:09 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-df380f34-673a-4c67-9ebf-82fa830d49d8" returned: 0 in 0.716s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] Lock "cinder-quobyte-df380f34-673a-4c67-9ebf-82fa830d49d8" released by "delete_volume" :: held 1.576s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] Created reservations ['1403c830-84ab-4072-bfa6-3dc1d95f71a1', 'ed7c3ff4-11c0-454c-b699-88c577bf1a40', '3ed8c24a-6b87-4407-8698-151d105489f1', '7e645c01-95a0-4a57-89c0-19368b46abcf'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:36:09 devstack sudo[103366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0cb85414-8972-435c-8218-cf8cedd9475d
Jun 18 11:36:09 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:09 devstack sudo[103368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:36:09 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:10 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802 1073741824" returned: 0 in 0.943s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:10 devstack sudo[103377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802
Jun 18 11:36:10 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:10 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0cb85414-8972-435c-8218-cf8cedd9475d" returned: 0 in 0.804s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0cb85414-8972-435c-8218-cf8cedd9475d {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:10 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.694s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:10 devstack sudo[103379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0cb85414-8972-435c-8218-cf8cedd9475d
Jun 18 11:36:10 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:10 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:36:10 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] Deleted volume successfully.
Jun 18 11:36:10 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0cff3c45-b52e-43b9-9735-e2135f049487 tempest-VolumesTransfersV357Test-1648024716 None] Lock "cinder-df380f34-673a-4c67-9ebf-82fa830d49d8-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:11 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802" returned: 0 in 0.744s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:11 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0cb85414-8972-435c-8218-cf8cedd9475d" returned: 0 in 0.695s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bfb64a9-d94a-4d2c-b43c-8eecd5f57389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1347cc53-66e0-4022-84f0-6fb4ee124802', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1db483-dc42-4e1d-8804-ff30348a49d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] Lock "cinder-quobyte-0cb85414-8972-435c-8218-cf8cedd9475d" released by "delete_volume" :: held 1.550s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:11 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Volume volume-1347cc53-66e0-4022-84f0-6fb4ee124802 (1347cc53-66e0-4022-84f0-6fb4ee124802): created successfully
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1db483-dc42-4e1d-8804-ff30348a49d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Flow 'volume_create_manager' (0d93c2e1-485a-42f1-a163-938f645781dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:11 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-93759cda-9dd6-4db7-ab87-23bc80503adc tempest-VolumesDeleteCascade-983906358 None] Created volume successfully.
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] Created reservations ['20eacf20-8332-4e81-8524-f27bfd67c193', 'bc08ff94-376f-48c8-b6a0-48e3215c4ea0', 'a75935c1-b21a-4e2e-a326-949c1ac621d4', '3c095985-e785-4587-bab0-f3a9e0154fd2'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:11 devstack sudo[103383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:36:11 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] Creating offline snapshot e98ae671-86d5-45df-992c-0aa46d835484 of volume 1347cc53-66e0-4022-84f0-6fb4ee124802 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[864948dc-831a-41a4-9c1a-bdb1f9258132]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:11 devstack sudo[103385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802
Jun 18 11:36:11 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:11 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.785s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:12 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:36:12 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] Deleted volume successfully.
Jun 18 11:36:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-32eb86a1-7bef-46bc-9a98-6f7c62bc6d15 tempest-VolumeQuotasAdminTestJSON-73977799 None] Lock "cinder-0cb85414-8972-435c-8218-cf8cedd9475d-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:12 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:36:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Flow 'volume_create_manager' (01566998-e14f-4967-a438-c585a269d06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec31d4a5-e3f4-4ea4-ab4b-63cabcc4496d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec31d4a5-e3f4-4ea4-ab4b-63cabcc4496d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-405363469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd96a511-3782-43f2-85e5-19379e14091b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69261e77d6d14fe4bf1724a9caf8f74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:12Z,use_quota=True,user_id='383dfcd3d4b742c6b51048c03db1ef81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d581d8-6314-45bc-b5fb-318b9de10bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d581d8-6314-45bc-b5fb-318b9de10bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6e6f1f-39b6-4be9-99df-4f2f322e459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6e6f1f-39b6-4be9-99df-4f2f322e459a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd96a511-3782-43f2-85e5-19379e14091b', 'volume_name': 'volume-dd96a511-3782-43f2-85e5-19379e14091b', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7fdaed-d4f3-4690-9209-9e5f15a1b17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7fdaed-d4f3-4690-9209-9e5f15a1b17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271cc01c-799e-41db-b1bb-4f48018e704e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:12 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Volume dd96a511-3782-43f2-85e5-19379e14091b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd96a511-3782-43f2-85e5-19379e14091b', 'volume_size': 1}
Jun 18 11:36:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:12 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802" returned: 0 in 0.990s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:12 devstack sudo[103391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484 1G
Jun 18 11:36:12 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:13 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484 1G" returned: 0 in 0.870s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1347cc53-66e0-4022-84f0-6fb4ee124802 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:13 devstack sudo[103397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1347cc53-66e0-4022-84f0-6fb4ee124802 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484
Jun 18 11:36:13 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:14 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1347cc53-66e0-4022-84f0-6fb4ee124802 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484" returned: 0 in 0.717s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:14 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484 is being set with open permissions: ugo+rw
Jun 18 11:36:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:14 devstack sudo[103403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484
Jun 18 11:36:14 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:14 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484" returned: 0 in 0.670s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:14 devstack sudo[103406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.info
Jun 18 11:36:14 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:15 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.info" returned: 0 in 0.669s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:15 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.info is being set with open permissions: ugo+rw
Jun 18 11:36:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:15 devstack sudo[103409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.info
Jun 18 11:36:15 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:16 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.info" returned: 0 in 0.659s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.667s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.713s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-405363469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd96a511-3782-43f2-85e5-19379e14091b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69261e77d6d14fe4bf1724a9caf8f74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:12Z,use_quota=True,user_id='383dfcd3d4b742c6b51048c03db1ef81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:36:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Creating volume dd96a511-3782-43f2-85e5-19379e14091b {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:36:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:36:16 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:36:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dd96a511-3782-43f2-85e5-19379e14091b 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:16 devstack sudo[103412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dd96a511-3782-43f2-85e5-19379e14091b 1073741824
Jun 18 11:36:16 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-94338468-a082-4fd0-a4d8-a51e74d14205 tempest-VolumesDeleteCascade-983906358 None] Create snapshot completed successfully
Jun 18 11:36:16 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-37244fe5-07f1-4fe9-9de5-f9530b2b70a6 tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:17 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dd96a511-3782-43f2-85e5-19379e14091b 1073741824" returned: 0 in 0.927s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dd96a511-3782-43f2-85e5-19379e14091b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:17 devstack sudo[103418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dd96a511-3782-43f2-85e5-19379e14091b
Jun 18 11:36:17 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:17 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dd96a511-3782-43f2-85e5-19379e14091b" returned: 0 in 0.661s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:36:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-37244fe5-07f1-4fe9-9de5-f9530b2b70a6 tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.891s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271cc01c-799e-41db-b1bb-4f48018e704e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd96a511-3782-43f2-85e5-19379e14091b', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80be2819-89fd-4d2a-9af2-d4914a32f392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-37244fe5-07f1-4fe9-9de5-f9530b2b70a6 tempest-VolumesDeleteCascade-983906358 None] Creating offline snapshot b9e42ea6-11ff-4bc5-9b05-570b1bdbb895 of volume 1347cc53-66e0-4022-84f0-6fb4ee124802 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:36:17 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Volume volume-dd96a511-3782-43f2-85e5-19379e14091b (dd96a511-3782-43f2-85e5-19379e14091b): created successfully
Jun 18 11:36:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80be2819-89fd-4d2a-9af2-d4914a32f392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Flow 'volume_create_manager' (01566998-e14f-4967-a438-c585a269d06a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:17 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01fd1af-b783-4b22-8863-565a55d7ab22]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-37244fe5-07f1-4fe9-9de5-f9530b2b70a6 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:17 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d8a16717-89c1-4e0f-b1ba-55b9de73e3f4 tempest-VolumeQuotasAdminTestJSON-73977799 None] Created volume successfully.
Jun 18 11:36:17 devstack sudo[103421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484
Jun 18 11:36:17 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:18 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-37244fe5-07f1-4fe9-9de5-f9530b2b70a6 tempest-VolumesDeleteCascade-983906358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484" returned: 0 in 0.837s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-37244fe5-07f1-4fe9-9de5-f9530b2b70a6 tempest-VolumesDeleteCascade-983906358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1347cc53-66e0-4022-84f0-6fb4ee124802(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:36:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-37244fe5-07f1-4fe9-9de5-f9530b2b70a6 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:18 devstack sudo[103426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895 1G
Jun 18 11:36:18 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:19 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-20228c36-152c-450d-80af-55265c6e065f tempest-VolumeQuotasAdminTestJSON-1497795468 None] Transfer volume completed successfully.
Jun 18 11:36:19 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-37244fe5-07f1-4fe9-9de5-f9530b2b70a6 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895 1G" returned: 0 in 1.066s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-37244fe5-07f1-4fe9-9de5-f9530b2b70a6 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:19 devstack sudo[103467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895
Jun 18 11:36:19 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:20 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-37244fe5-07f1-4fe9-9de5-f9530b2b70a6 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895" returned: 0 in 0.771s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:20 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-37244fe5-07f1-4fe9-9de5-f9530b2b70a6 tempest-VolumesDeleteCascade-983906358 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895 is being set with open permissions: ugo+rw
Jun 18 11:36:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-37244fe5-07f1-4fe9-9de5-f9530b2b70a6 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] Acquiring lock "cinder-dd96a511-3782-43f2-85e5-19379e14091b-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:20 devstack sudo[103474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895
Jun 18 11:36:20 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] Lock "cinder-dd96a511-3782-43f2-85e5-19379e14091b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] Acquiring lock "cinder-quobyte-dd96a511-3782-43f2-85e5-19379e14091b" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] Lock "cinder-quobyte-dd96a511-3782-43f2-85e5-19379e14091b" acquired by "delete_volume" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:20 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[6353102d-675c-44dd-a81a-04fbc9193abb]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dd96a511-3782-43f2-85e5-19379e14091b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:20 devstack sudo[103476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dd96a511-3782-43f2-85e5-19379e14091b
Jun 18 11:36:20 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:21 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-37244fe5-07f1-4fe9-9de5-f9530b2b70a6 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895" returned: 0 in 0.714s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-37244fe5-07f1-4fe9-9de5-f9530b2b70a6 tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.531s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:21 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-37244fe5-07f1-4fe9-9de5-f9530b2b70a6 tempest-VolumesDeleteCascade-983906358 None] Create snapshot completed successfully
Jun 18 11:36:21 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dd96a511-3782-43f2-85e5-19379e14091b" returned: 0 in 0.828s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dd96a511-3782-43f2-85e5-19379e14091b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:21 devstack sudo[103483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dd96a511-3782-43f2-85e5-19379e14091b
Jun 18 11:36:21 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:22 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dd96a511-3782-43f2-85e5-19379e14091b" returned: 0 in 0.649s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] Lock "cinder-quobyte-dd96a511-3782-43f2-85e5-19379e14091b" released by "delete_volume" :: held 1.525s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "cinder-1347cc53-66e0-4022-84f0-6fb4ee124802-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-1347cc53-66e0-4022-84f0-6fb4ee124802-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Performing cascade delete. {{(pid=91663) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "cinder-b9e42ea6-11ff-4bc5-9b05-570b1bdbb895-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] Created reservations ['a3f9610f-5d71-4c6a-b4d5-f7529b8a273d', '41887551-a723-4a0d-a37e-c8a4405a24ff', '55e34184-98e4-4c45-b261-c66ff845a879', '19f0ea5d-907b-46c7-8d4d-d1b53cc18f21'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-b9e42ea6-11ff-4bc5-9b05-570b1bdbb895-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "cinder-quobyte-1347cc53-66e0-4022-84f0-6fb4ee124802" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-1347cc53-66e0-4022-84f0-6fb4ee124802" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "cinder-quobyte-b9e42ea6-11ff-4bc5-9b05-570b1bdbb895" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-b9e42ea6-11ff-4bc5-9b05-570b1bdbb895" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Deleting offline snapshot b9e42ea6-11ff-4bc5-9b05-570b1bdbb895 of volume 1347cc53-66e0-4022-84f0-6fb4ee124802 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] snapshot_file for this snap is: volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6bab80-4340-4d1f-95b5-f3d8f95531d3]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:22 devstack sudo[103486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:36:22 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:22 devstack sudo[103487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895
Jun 18 11:36:22 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:23 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.766s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:23 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:36:23 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] Deleted volume successfully.
Jun 18 11:36:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-47404907-c90b-4a5c-a3f0-25c396efb70c tempest-VolumeQuotasAdminTestJSON-939799690 None] Lock "cinder-dd96a511-3782-43f2-85e5-19379e14091b-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:23 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895" returned: 0 in 1.007s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:23 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1347cc53-66e0-4022-84f0-6fb4ee124802(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:36:23 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7ca6f3-02ed-4c4a-8a98-cfd06fb04f81]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:23 devstack sudo[103494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484
Jun 18 11:36:23 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:24 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484" returned: 0 in 0.910s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:24 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1347cc53-66e0-4022-84f0-6fb4ee124802(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:36:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:24 devstack sudo[103499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895
Jun 18 11:36:24 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:25 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895" returned: 0 in 0.836s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:25 devstack sudo[103504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895
Jun 18 11:36:25 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:36:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:25 devstack sudo[103506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:36:25 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:25 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.b9e42ea6-11ff-4bc5-9b05-570b1bdbb895" returned: 0 in 0.771s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-b9e42ea6-11ff-4bc5-9b05-570b1bdbb895" released by "_delete_snapshot" :: held 3.658s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-1347cc53-66e0-4022-84f0-6fb4ee124802" released by "delete_snapshot" :: held 3.689s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Created reservations ['d6e10ede-9277-4741-bce5-a5adcd952478', 'b5b87a02-9bb7-4440-8b79-60ef8a3ba57a', '6f03f8ed-a22c-47be-8f59-f30e1490c5e2', '4c77976e-5d90-4547-84bc-088b021f7b54'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:36:26 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Delete snapshot completed successfully.
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-b9e42ea6-11ff-4bc5-9b05-570b1bdbb895-delete_snapshot" released by "delete_snapshot" :: held 3.948s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "cinder-e98ae671-86d5-45df-992c-0aa46d835484-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-e98ae671-86d5-45df-992c-0aa46d835484-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "cinder-quobyte-1347cc53-66e0-4022-84f0-6fb4ee124802" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-1347cc53-66e0-4022-84f0-6fb4ee124802" acquired by "delete_snapshot" :: waited 0.033s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "cinder-quobyte-e98ae671-86d5-45df-992c-0aa46d835484" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:26 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.940s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-e98ae671-86d5-45df-992c-0aa46d835484" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Deleting offline snapshot e98ae671-86d5-45df-992c-0aa46d835484 of volume 1347cc53-66e0-4022-84f0-6fb4ee124802 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] snapshot_file for this snap is: volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ede572-9b0c-4777-9346-f7c9286a11aa]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:26 devstack sudo[103510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484
Jun 18 11:36:26 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:27 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484" returned: 0 in 0.940s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:27 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1347cc53-66e0-4022-84f0-6fb4ee124802(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:36:27 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[8377dfb3-811a-4c8d-bd57-e56e85dbeef9]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:27 devstack sudo[103517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802
Jun 18 11:36:27 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:36:28 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Flow 'volume_create_manager' (1e4f61b3-d814-4c5a-8d5d-031267288e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9686578-2ea3-4fc6-8a59-24ccebc38a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802" returned: 0 in 1.088s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9686578-2ea3-4fc6-8a59-24ccebc38a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-275945842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bdaff2f-01ba-4455-8392-4f9df818bad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfec25c6afed4b548197b853fe22fc8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:28Z,use_quota=True,user_id='99725248d5404ca482f98c979ae41578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:28 devstack sudo[103522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88aea6e9-7886-46f9-b792-cc2fb6237860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:28 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88aea6e9-7886-46f9-b792-cc2fb6237860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8481f5f-23b8-4b0d-be6b-863915c861e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8481f5f-23b8-4b0d-be6b-863915c861e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bdaff2f-01ba-4455-8392-4f9df818bad4', 'volume_name': 'volume-9bdaff2f-01ba-4455-8392-4f9df818bad4', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92cfa66-a486-4ca1-9433-b3be40dbacea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92cfa66-a486-4ca1-9433-b3be40dbacea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda28e28-9aa8-4b08-ba0a-68b04cb7ab77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:28 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Volume 9bdaff2f-01ba-4455-8392-4f9df818bad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bdaff2f-01ba-4455-8392-4f9df818bad4', 'volume_size': 1}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-275945842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bdaff2f-01ba-4455-8392-4f9df818bad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfec25c6afed4b548197b853fe22fc8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:28Z,use_quota=True,user_id='99725248d5404ca482f98c979ae41578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Creating volume 9bdaff2f-01ba-4455-8392-4f9df818bad4 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:36:28 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:36:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:28 devstack sudo[103524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4 1073741824
Jun 18 11:36:28 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:29 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484" returned: 0 in 0.850s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:29 devstack sudo[103534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484
Jun 18 11:36:29 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:29 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4 1073741824" returned: 0 in 0.914s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:29 devstack sudo[103537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4
Jun 18 11:36:29 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:30 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802.e98ae671-86d5-45df-992c-0aa46d835484" returned: 0 in 0.670s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-e98ae671-86d5-45df-992c-0aa46d835484" released by "_delete_snapshot" :: held 3.702s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-1347cc53-66e0-4022-84f0-6fb4ee124802" released by "delete_snapshot" :: held 3.744s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Created reservations ['6c9f7675-2da3-453f-bb63-831527900b92', '43469f1b-65d4-4509-bd1c-f8e9b424dcf2', '12cdc7e0-40c7-4fe8-ad12-4f29a8756573', 'd4b5f4de-d571-4bc8-886c-b74de88f0313'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:36:30 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Delete snapshot completed successfully.
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-e98ae671-86d5-45df-992c-0aa46d835484-delete_snapshot" released by "delete_snapshot" :: held 3.966s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Snapshots deleted, issuing volume delete {{(pid=91663) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "cinder-quobyte-1347cc53-66e0-4022-84f0-6fb4ee124802" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-1347cc53-66e0-4022-84f0-6fb4ee124802" acquired by "delete_volume" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:30 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4" returned: 0 in 0.699s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda28e28-9aa8-4b08-ba0a-68b04cb7ab77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bdaff2f-01ba-4455-8392-4f9df818bad4', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721fb23d-383c-427d-b83d-554ea7170ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbd2192-f235-46c3-b562-ed6465e4e61a]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:30 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Volume volume-9bdaff2f-01ba-4455-8392-4f9df818bad4 (9bdaff2f-01ba-4455-8392-4f9df818bad4): created successfully
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721fb23d-383c-427d-b83d-554ea7170ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Flow 'volume_create_manager' (1e4f61b3-d814-4c5a-8d5d-031267288e6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:30 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-21142801-7aea-4c4c-b12b-179790a427bf tempest-VolumesSnapshotTestJSON-1640399948 None] Created volume successfully.
Jun 18 11:36:30 devstack sudo[103541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802
Jun 18 11:36:30 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Flow 'volume_create_manager' (81a3bdca-571f-4355-bcdb-9c14141f08db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2d55dc-d7d9-448a-837b-4014be26b5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2d55dc-d7d9-448a-837b-4014be26b5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-584439962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76f4438-be14-4d2a-9707-ec369310141a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79868d5dbb64ed5a57af7252bd6923f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:31Z,use_quota=True,user_id='6e940a35534d4b7a95415edad6421cf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26652cd1-fecf-4fa6-aad7-40cf7f1f4a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26652cd1-fecf-4fa6-aad7-40cf7f1f4a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19bcdae6-3358-41d8-84c7-142de3b89a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19bcdae6-3358-41d8-84c7-142de3b89a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c76f4438-be14-4d2a-9707-ec369310141a', 'volume_name': 'volume-c76f4438-be14-4d2a-9707-ec369310141a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f807511c-02bd-4560-aa5d-9f7d4223c635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f807511c-02bd-4560-aa5d-9f7d4223c635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1f0608-7fd4-484f-9c3c-518b89af115e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:30 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Volume c76f4438-be14-4d2a-9707-ec369310141a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c76f4438-be14-4d2a-9707-ec369310141a', 'volume_size': 1}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-584439962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76f4438-be14-4d2a-9707-ec369310141a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79868d5dbb64ed5a57af7252bd6923f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:31Z,use_quota=True,user_id='6e940a35534d4b7a95415edad6421cf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Creating volume c76f4438-be14-4d2a-9707-ec369310141a {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:36:30 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76f4438-be14-4d2a-9707-ec369310141a 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:30 devstack sudo[103543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76f4438-be14-4d2a-9707-ec369310141a 1073741824
Jun 18 11:36:30 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:31 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802" returned: 0 in 0.861s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:31 devstack sudo[103548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802
Jun 18 11:36:31 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:31 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76f4438-be14-4d2a-9707-ec369310141a 1073741824" returned: 0 in 0.827s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76f4438-be14-4d2a-9707-ec369310141a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:31 devstack sudo[103555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76f4438-be14-4d2a-9707-ec369310141a
Jun 18 11:36:31 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:31 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1347cc53-66e0-4022-84f0-6fb4ee124802" returned: 0 in 0.656s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:31 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-1347cc53-66e0-4022-84f0-6fb4ee124802" released by "delete_volume" :: held 1.593s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:31 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Created reservations ['ba1b6207-df44-4cff-82af-e4551b1b83fa', '6222024d-14db-4629-97b5-b5d22b9054b2', 'c65046df-024f-4916-a7b0-f2417a4b0d27', '132d6d40-0829-4f22-8feb-eb7ef7531b45'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:36:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:31 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:31 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:31 devstack sudo[103557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:36:31 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:32 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76f4438-be14-4d2a-9707-ec369310141a" returned: 0 in 0.692s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.533s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1f0608-7fd4-484f-9c3c-518b89af115e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76f4438-be14-4d2a-9707-ec369310141a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66eea2e3-8bbf-4597-a8bc-ac8ae79d3fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] Creating offline snapshot 5575c12b-c144-46af-8c03-8a45d2fc12de of volume 9bdaff2f-01ba-4455-8392-4f9df818bad4 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:36:32 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Volume volume-c76f4438-be14-4d2a-9707-ec369310141a (c76f4438-be14-4d2a-9707-ec369310141a): created successfully
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66eea2e3-8bbf-4597-a8bc-ac8ae79d3fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Flow 'volume_create_manager' (81a3bdca-571f-4355-bcdb-9c14141f08db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cecdd3e-c402-4cfc-b3b8-8ac498db87f4]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:32 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-ec83636e-c4ba-4a29-9dfb-965b57bec828 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Created volume successfully.
Jun 18 11:36:32 devstack sudo[103560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4
Jun 18 11:36:32 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:32 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.720s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:36:32 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Deleted volume successfully.
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Flow 'volume_create_manager' (c99f1241-e84f-4021-a571-6d1bd24fbdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015ee04d-a6de-4af9-ab6c-6d8f6e5d3292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2ffaef3d-0461-4a73-9bab-db6d8c4bb30f tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-1347cc53-66e0-4022-84f0-6fb4ee124802-delete_volume" released by "delete_volume" :: held 10.532s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015ee04d-a6de-4af9-ab6c-6d8f6e5d3292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1194192098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a26d2f5-7d60-468a-bbbe-5c0b430d60f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69d65946fd241baa0a554165dbf8c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:33Z,use_quota=True,user_id='3814b24e4be14f92979a17303797d8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ceca162-da7d-4d0d-8618-fa8f134f4f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ceca162-da7d-4d0d-8618-fa8f134f4f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b993151e-7f2f-465f-8287-6642fd477873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b993151e-7f2f-465f-8287-6642fd477873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a26d2f5-7d60-468a-bbbe-5c0b430d60f3', 'volume_name': 'volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56577440-7950-4c2c-9fe5-6672279c605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56577440-7950-4c2c-9fe5-6672279c605d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eddbe2a-948e-4b2a-a22c-869bd2a2299a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:32 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Volume 5a26d2f5-7d60-468a-bbbe-5c0b430d60f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3', 'volume_size': 1}
Jun 18 11:36:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:33 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4" returned: 0 in 0.810s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:33 devstack sudo[103566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de 1G
Jun 18 11:36:33 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:33 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Acquiring lock "cinder-c76f4438-be14-4d2a-9707-ec369310141a-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:33 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Lock "cinder-c76f4438-be14-4d2a-9707-ec369310141a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Acquiring lock "cinder-quobyte-c76f4438-be14-4d2a-9707-ec369310141a" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Lock "cinder-quobyte-c76f4438-be14-4d2a-9707-ec369310141a" acquired by "delete_volume" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:34 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81d679f-33ea-4400-bef8-fd9a64594327]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76f4438-be14-4d2a-9707-ec369310141a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:34 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de 1G" returned: 0 in 0.841s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdaff2f-01ba-4455-8392-4f9df818bad4 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:34 devstack sudo[103572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76f4438-be14-4d2a-9707-ec369310141a
Jun 18 11:36:34 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:34 devstack sudo[103573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdaff2f-01ba-4455-8392-4f9df818bad4 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de
Jun 18 11:36:34 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:34 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:34 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76f4438-be14-4d2a-9707-ec369310141a" returned: 0 in 0.798s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76f4438-be14-4d2a-9707-ec369310141a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdaff2f-01ba-4455-8392-4f9df818bad4 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de" returned: 0 in 0.709s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:34 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de is being set with open permissions: ugo+rw
Jun 18 11:36:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:34 devstack sudo[103582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76f4438-be14-4d2a-9707-ec369310141a
Jun 18 11:36:34 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:34 devstack sudo[103583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de
Jun 18 11:36:34 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:35 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76f4438-be14-4d2a-9707-ec369310141a" returned: 0 in 0.645s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:35 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de" returned: 0 in 0.646s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:35 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Lock "cinder-quobyte-c76f4438-be14-4d2a-9707-ec369310141a" released by "delete_volume" :: held 1.487s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:35 devstack sudo[103588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.info
Jun 18 11:36:35 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:35 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Created reservations ['2b43df5c-9319-41f9-bd8a-c140a174f8eb', '8595bf50-5aa8-4a25-b35f-be8e40209ccb', 'b119e9ae-0140-43c6-bf42-d3c53ea88c11', '9ee10761-4854-4d02-a53f-49fafd5334ef'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:36:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:35 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:35 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:35 devstack sudo[103590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:36:35 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:36 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.info" returned: 0 in 0.655s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:36 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.info is being set with open permissions: ugo+rw
Jun 18 11:36:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:36 devstack sudo[103594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.info
Jun 18 11:36:36 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:36 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.669s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:36 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:36:36 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Deleted volume successfully.
Jun 18 11:36:36 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-dbac1272-ae12-4ec4-a627-4bec37038411 tempest-VolumeQuotasNegativeTestJSON-1519948487 None] Lock "cinder-c76f4438-be14-4d2a-9707-ec369310141a-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:36 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.info" returned: 0 in 0.664s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.470s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.099s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1194192098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a26d2f5-7d60-468a-bbbe-5c0b430d60f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69d65946fd241baa0a554165dbf8c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:33Z,use_quota=True,user_id='3814b24e4be14f92979a17303797d8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:36:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Creating volume 5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:36:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:36 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:36:36 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:36:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:36 devstack sudo[103597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 1073741824
Jun 18 11:36:36 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:36 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-0b557c61-e521-4ee5-aff6-700feedea0b0 tempest-VolumesSnapshotTestJSON-1640399948 None] Create snapshot completed successfully
Jun 18 11:36:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-5575c12b-c144-46af-8c03-8a45d2fc12de-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-5575c12b-c144-46af-8c03-8a45d2fc12de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-quobyte-9bdaff2f-01ba-4455-8392-4f9df818bad4" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-9bdaff2f-01ba-4455-8392-4f9df818bad4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-quobyte-5575c12b-c144-46af-8c03-8a45d2fc12de" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-5575c12b-c144-46af-8c03-8a45d2fc12de" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:37 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] Deleting offline snapshot 5575c12b-c144-46af-8c03-8a45d2fc12de of volume 9bdaff2f-01ba-4455-8392-4f9df818bad4 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:36:37 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] snapshot_file for this snap is: volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:36:37 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc551b4-c147-4ae6-94bc-d59cd8fa8995]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:37 devstack sudo[103599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de
Jun 18 11:36:37 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:37 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 1073741824" returned: 0 in 1.019s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:37 devstack sudo[103604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3
Jun 18 11:36:37 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de" returned: 0 in 0.875s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bdaff2f-01ba-4455-8392-4f9df818bad4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:36:38 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:38 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[e200e2a8-355b-449d-afee-4e2abf2c1ede]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:38 devstack sudo[103609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4
Jun 18 11:36:38 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:38 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3" returned: 0 in 0.725s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:36:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:38 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=116,cinder:INSERT=36,cinder:UPDATE=150,cinder:DELETE=11 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:36:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eddbe2a-948e-4b2a-a22c-869bd2a2299a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be0190a-0108-43df-802f-c14aa1c391a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:38 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Volume volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 (5a26d2f5-7d60-468a-bbbe-5c0b430d60f3): created successfully
Jun 18 11:36:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be0190a-0108-43df-802f-c14aa1c391a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Flow 'volume_create_manager' (c99f1241-e84f-4021-a571-6d1bd24fbdf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:38 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-0f0e1b37-c84d-4655-9ac6-deed57af6214 tempest-VolumesDeleteCascade-983906358 None] Created volume successfully.
Jun 18 11:36:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:39 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] Creating offline snapshot dc0ef663-0a69-4dcd-9855-6fdc311bf75c of volume 5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:36:39 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:39 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15cec60-c72f-42f8-9026-94dafc6bfb49]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4" returned: 0 in 0.907s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:39 devstack sudo[103616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de
Jun 18 11:36:39 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:39 devstack sudo[103615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3
Jun 18 11:36:39 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:40 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3" returned: 0 in 0.804s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:40 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de" returned: 0 in 0.818s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:40 devstack sudo[103628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c 1G
Jun 18 11:36:40 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:40 devstack sudo[103630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de
Jun 18 11:36:40 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:40 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4.5575c12b-c144-46af-8c03-8a45d2fc12de" returned: 0 in 0.681s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:40 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-5575c12b-c144-46af-8c03-8a45d2fc12de" released by "_delete_snapshot" :: held 3.423s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:40 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-9bdaff2f-01ba-4455-8392-4f9df818bad4" released by "delete_snapshot" :: held 3.448s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:40 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c 1G" returned: 0 in 0.857s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:40 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] Created reservations ['bfb202a0-74e2-4f49-b901-40a2c40fba05', '0933e082-9b78-4709-80d8-72077f2d9511', 'b5297045-7bad-44eb-84e0-f1d8a61dbc0c', '16e7f24e-4d94-4895-8f23-c6a9bcd4862c'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:36:40 devstack sudo[103640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c
Jun 18 11:36:40 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:41 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] Delete snapshot completed successfully.
Jun 18 11:36:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8599db76-2310-4eae-bc9c-9fda4ff4a342 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-5575c12b-c144-46af-8c03-8a45d2fc12de-delete_snapshot" released by "delete_snapshot" :: held 3.700s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:41 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c" returned: 0 in 0.774s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:41 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c is being set with open permissions: ugo+rw
Jun 18 11:36:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:41 devstack sudo[103646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c
Jun 18 11:36:41 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:42 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=126,cinder:INSERT=30,cinder:UPDATE=134,cinder:DELETE=11 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:36:42 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:36:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Flow 'volume_create_manager' (c69daf52-8506-412f-8f7d-4c6438bd5e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9bacfc-b153-48e2-a2ef-91eb7e0d7b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9bacfc-b153-48e2-a2ef-91eb7e0d7b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-726706564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfec25c6afed4b548197b853fe22fc8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:42Z,use_quota=True,user_id='99725248d5404ca482f98c979ae41578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a66321-fd6f-4880-ad22-e183a51d20b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a66321-fd6f-4880-ad22-e183a51d20b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a08e0da-170c-49a3-b4be-9ac3d9110223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a08e0da-170c-49a3-b4be-9ac3d9110223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f', 'volume_name': 'volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e69e3fe-43c6-4b30-a6e8-1b89abaa1e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e69e3fe-43c6-4b30-a6e8-1b89abaa1e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9045f13b-aee9-447b-97f1-5c26338beb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:42 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Volume 5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f', 'volume_size': 1}
Jun 18 11:36:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:42 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c" returned: 0 in 0.752s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:42 devstack sudo[103649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.info
Jun 18 11:36:42 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:43 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.info" returned: 0 in 0.733s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:43 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.info is being set with open permissions: ugo+rw
Jun 18 11:36:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:43 devstack sudo[103652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.info
Jun 18 11:36:43 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:43 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.info" returned: 0 in 0.690s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.713s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.567s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-726706564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfec25c6afed4b548197b853fe22fc8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:42Z,use_quota=True,user_id='99725248d5404ca482f98c979ae41578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:36:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Creating volume 5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:36:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:36:43 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:36:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:43 devstack sudo[103655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f 1073741824
Jun 18 11:36:43 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:43 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-f95e3c55-8d6c-48d1-b422-71be13412b82 tempest-VolumesDeleteCascade-983906358 None] Create snapshot completed successfully
Jun 18 11:36:44 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f 1073741824" returned: 0 in 0.995s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:45 devstack sudo[103662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f
Jun 18 11:36:45 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Flow 'volume_create_manager' (2e0404c3-f3bb-4289-bd2c-a924d93ee383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4a6622-4e7e-41de-a5bc-4e4cf0783255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4a6622-4e7e-41de-a5bc-4e4cf0783255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1905973866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34f62e8-bf9f-4c3b-a90d-e75209ef05b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69d65946fd241baa0a554165dbf8c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dc0ef663-0a69-4dcd-9855-6fdc311bf75c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:45Z,use_quota=True,user_id='3814b24e4be14f92979a17303797d8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f62c53-106c-41d5-9e52-9cbaca7151bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f62c53-106c-41d5-9e52-9cbaca7151bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1a9832-1b0b-4e36-b7c7-1ef3a55bb014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1a9832-1b0b-4e36-b7c7-1ef3a55bb014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b34f62e8-bf9f-4c3b-a90d-e75209ef05b9', 'volume_name': 'volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9', 'volume_size': 1, 'snapshot_id': 'dc0ef663-0a69-4dcd-9855-6fdc311bf75c'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95243530-a72a-4a9f-bacb-41a92d54c2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95243530-a72a-4a9f-bacb-41a92d54c2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283e3452-664f-4585-beed-49bb95b93904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:45 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Volume b34f62e8-bf9f-4c3b-a90d-e75209ef05b9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9', 'volume_size': 1, 'snapshot_id': 'dc0ef663-0a69-4dcd-9855-6fdc311bf75c'}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:45 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f" returned: 0 in 0.680s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.488s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "cinder-quobyte-dc0ef663-0a69-4dcd-9855-6fdc311bf75c-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9" by "_create_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-dc0ef663-0a69-4dcd-9855-6fdc311bf75c-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Creating volume b34f62e8-bf9f-4c3b-a90d-e75209ef05b9 from snapshot dc0ef663-0a69-4dcd-9855-6fdc311bf75c {{(pid=91663) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "cinder-quobyte-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9" by "_copy_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9045f13b-aee9-447b-97f1-5c26338beb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2df511-58ec-4998-adaf-4a13c44d8460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] snapshot: dc0ef663-0a69-4dcd-9855-6fdc311bf75c, volume: b34f62e8-bf9f-4c3b-a90d-e75209ef05b9,  {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 18 11:36:45 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Volume volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f (5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f): created successfully
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2df511-58ec-4998-adaf-4a13c44d8460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Flow 'volume_create_manager' (c69daf52-8506-412f-8f7d-4c6438bd5e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:45 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-4006f792-7ddb-4d59-8181-41dc9eab5563 tempest-VolumesSnapshotTestJSON-1640399948 None] Created volume successfully.
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff58b70-9e81-4db5-8698-f7626a9710a0]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:45 devstack sudo[103665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c
Jun 18 11:36:45 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:46 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c" returned: 0 in 0.802s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:36:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 18 11:36:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Creating direct copy from snapshot {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 18 11:36:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:46 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abcc5b1-1438-41c2-b83b-3bd1b3450e2a]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:46 devstack sudo[103670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3
Jun 18 11:36:46 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:47 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3" returned: 0 in 0.803s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:47 devstack cinder-volume[91663]: DEBUG cinder.utils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Path /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9 not found in is_blk_device check {{(pid=91663) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 18 11:36:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:47 devstack sudo[103675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9
Jun 18 11:36:47 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:52 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9" returned: 0 in 5.123s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:52 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d76fc1-30d6-4a1f-a7da-8fd67485a15f]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:52 devstack sudo[103689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3
Jun 18 11:36:52 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:53 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3" returned: 0 in 0.905s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:53 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3, size 1024.00 MB, duration 5.12 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9 {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:36:53 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Converted 1024.00 MB image at 199.81 MB/s
Jun 18 11:36:53 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9 is being set with open permissions: ugo+rw
Jun 18 11:36:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:53 devstack sudo[103694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9
Jun 18 11:36:53 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:53 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:36:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Flow 'volume_create_manager' (bf2365a5-ef5c-4978-b38c-5cfde948d533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d2e062-5f0c-4760-a7cc-94e7ce43885c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d2e062-5f0c-4760-a7cc-94e7ce43885c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1095244235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0722bf43-5238-48ea-8544-b5df719ea717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e67a2ff8155648ef9a7ffb010ddaf3f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:53Z,use_quota=True,user_id='c3c9b624b2264d459bda68102b67009b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce92deb-c2d1-46bb-83bc-579b72ec3558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce92deb-c2d1-46bb-83bc-579b72ec3558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff2e33b-c5be-43e4-80c8-33799ebec5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff2e33b-c5be-43e4-80c8-33799ebec5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0722bf43-5238-48ea-8544-b5df719ea717', 'volume_name': 'volume-0722bf43-5238-48ea-8544-b5df719ea717', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36e3a9d-3993-4392-85f7-83b197fc708f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36e3a9d-3993-4392-85f7-83b197fc708f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b0dbdd-abff-4e2f-88c0-c2df2020cbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:53 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Volume 0722bf43-5238-48ea-8544-b5df719ea717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0722bf43-5238-48ea-8544-b5df719ea717', 'volume_size': 1}
Jun 18 11:36:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:54 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9" returned: 0 in 0.620s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9" released by "_copy_volume_from_snapshot" :: held 8.384s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-dc0ef663-0a69-4dcd-9855-6fdc311bf75c-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9" released by "_create_volume_from_snapshot" :: held 8.433s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.453s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.495s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] Creating offline snapshot 7ff9ed67-943a-4817-a43a-88ff5d9e42b8 of volume 5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283e3452-664f-4585-beed-49bb95b93904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9', 'volume_size': 1, 'snapshot_id': 'dc0ef663-0a69-4dcd-9855-6fdc311bf75c'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69d37a3-ab82-403e-8d91-4f1ddef93496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e224ccd-2a48-4547-947a-7d4d8bca88b1]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:54 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Volume volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9 (b34f62e8-bf9f-4c3b-a90d-e75209ef05b9): created successfully
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69d37a3-ab82-403e-8d91-4f1ddef93496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Flow 'volume_create_manager' (2e0404c3-f3bb-4289-bd2c-a924d93ee383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:54 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-cdd801d9-43cd-4024-b6cd-b9c849172c4c tempest-VolumesDeleteCascade-983906358 None] Created volume successfully.
Jun 18 11:36:54 devstack sudo[103697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f
Jun 18 11:36:54 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "cinder-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Performing cascade delete. {{(pid=91663) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "cinder-dc0ef663-0a69-4dcd-9855-6fdc311bf75c-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-dc0ef663-0a69-4dcd-9855-6fdc311bf75c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:54 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f" returned: 0 in 0.791s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "cinder-quobyte-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:54 devstack sudo[103702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8 1G
Jun 18 11:36:54 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "cinder-quobyte-dc0ef663-0a69-4dcd-9855-6fdc311bf75c" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-dc0ef663-0a69-4dcd-9855-6fdc311bf75c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:55 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Deleting offline snapshot dc0ef663-0a69-4dcd-9855-6fdc311bf75c of volume 5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:36:55 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] snapshot_file for this snap is: volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:36:55 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81ea3c8-bf30-48a7-bc77-49c9867e8220]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:55 devstack sudo[103704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c
Jun 18 11:36:55 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:55 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8 1G" returned: 0 in 0.816s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:55 devstack sudo[103712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8
Jun 18 11:36:55 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:55 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c" returned: 0 in 0.770s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:55 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:36:55 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bebdbb-e1f6-4dee-a581-4c3e883c1cc6]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:55 devstack sudo[103714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3
Jun 18 11:36:55 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:56 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8" returned: 0 in 0.684s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:56 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8 is being set with open permissions: ugo+rw
Jun 18 11:36:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:56 devstack sudo[103721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8
Jun 18 11:36:56 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:56 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3" returned: 0 in 0.759s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:56 devstack sudo[103724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c
Jun 18 11:36:56 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:57 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8" returned: 0 in 0.657s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:57 devstack sudo[103730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.info
Jun 18 11:36:57 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:57 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c" returned: 0 in 0.728s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:57 devstack sudo[103732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c
Jun 18 11:36:57 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:57 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.info" returned: 0 in 0.658s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:57 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.info is being set with open permissions: ugo+rw
Jun 18 11:36:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:57 devstack sudo[103735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.info
Jun 18 11:36:57 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:57 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3.dc0ef663-0a69-4dcd-9855-6fdc311bf75c" returned: 0 in 0.646s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-dc0ef663-0a69-4dcd-9855-6fdc311bf75c" released by "_delete_snapshot" :: held 3.007s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3" released by "delete_snapshot" :: held 3.030s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Created reservations ['b506db90-508f-4043-b0da-f87d35eff9f5', '74381aee-0bf0-4a67-ac03-4a3007248ada', '137cb5d4-f7e0-4c3c-8a3a-63520a323900', 'bc4acceb-8a21-4c75-b110-85479d5c396d'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:36:58 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Delete snapshot completed successfully.
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-dc0ef663-0a69-4dcd-9855-6fdc311bf75c-delete_snapshot" released by "delete_snapshot" :: held 3.209s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Snapshots deleted, issuing volume delete {{(pid=91663) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "cinder-quobyte-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3" acquired by "delete_volume" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80dc753-1a8f-424d-9a18-1ddf1c070a79]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:58 devstack sudo[103738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3
Jun 18 11:36:58 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:58 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.info" returned: 0 in 0.662s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.377s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.909s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1095244235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0722bf43-5238-48ea-8544-b5df719ea717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e67a2ff8155648ef9a7ffb010ddaf3f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:36:53Z,use_quota=True,user_id='c3c9b624b2264d459bda68102b67009b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Creating volume 0722bf43-5238-48ea-8544-b5df719ea717 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:36:58 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:36:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0722bf43-5238-48ea-8544-b5df719ea717 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:58 devstack sudo[103741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0722bf43-5238-48ea-8544-b5df719ea717 1073741824
Jun 18 11:36:58 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:58 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-cd6b936d-739d-4946-ada2-cb85e7e5a6f0 tempest-VolumesSnapshotTestJSON-1640399948 None] Create snapshot completed successfully
Jun 18 11:36:59 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3" returned: 0 in 0.781s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:59 devstack sudo[103746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3
Jun 18 11:36:59 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:59 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0722bf43-5238-48ea-8544-b5df719ea717 1073741824" returned: 0 in 0.892s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0722bf43-5238-48ea-8544-b5df719ea717 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:59 devstack sudo[103751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0722bf43-5238-48ea-8544-b5df719ea717
Jun 18 11:36:59 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:59 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root
Jun 18 11:36:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3" returned: 0 in 0.657s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:36:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3" released by "delete_volume" :: held 1.513s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:36:59 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Created reservations ['71a73b21-efa3-41b3-a3b3-fe240ba4c9a0', 'fd7dcfd0-f7a4-475c-b3e0-8ad51e30a613', '1e33634b-50c4-4443-9102-bc92fc2eb6ce', '1c070b1d-26ba-43de-8b63-776dc994b3a6'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:36:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:36:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:36:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:36:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:36:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:36:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:36:59 devstack sudo[103755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:36:59 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:36:59 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:36:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Flow 'volume_create_manager' (87c48ca5-dada-45f0-bc10-bf61788a2d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:36:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e517c0f-cf7b-45ab-8c12-dc85492875e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e517c0f-cf7b-45ab-8c12-dc85492875e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1420370368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c6aa5e2-5469-415c-8483-9b5346c3e318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfec25c6afed4b548197b853fe22fc8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7ff9ed67-943a-4817-a43a-88ff5d9e42b8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:00Z,use_quota=True,user_id='99725248d5404ca482f98c979ae41578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0ef72e-2fac-466b-b18d-e210985d3647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0ef72e-2fac-466b-b18d-e210985d3647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ed0382-444a-418c-a214-68b3019a2f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ed0382-444a-418c-a214-68b3019a2f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4c6aa5e2-5469-415c-8483-9b5346c3e318', 'volume_name': 'volume-4c6aa5e2-5469-415c-8483-9b5346c3e318', 'volume_size': 2, 'snapshot_id': '7ff9ed67-943a-4817-a43a-88ff5d9e42b8'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1c6ff0-4093-424c-a9a5-ba1cc0d74dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1c6ff0-4093-424c-a9a5-ba1cc0d74dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc75706-69d8-465f-ab0d-837895b918e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:00 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Volume 4c6aa5e2-5469-415c-8483-9b5346c3e318: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4c6aa5e2-5469-415c-8483-9b5346c3e318', 'volume_size': 2, 'snapshot_id': '7ff9ed67-943a-4817-a43a-88ff5d9e42b8'}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:00 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0722bf43-5238-48ea-8544-b5df719ea717" returned: 0 in 0.734s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.130s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-quobyte-7ff9ed67-943a-4817-a43a-88ff5d9e42b8-4c6aa5e2-5469-415c-8483-9b5346c3e318" by "_create_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-7ff9ed67-943a-4817-a43a-88ff5d9e42b8-4c6aa5e2-5469-415c-8483-9b5346c3e318" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Creating volume 4c6aa5e2-5469-415c-8483-9b5346c3e318 from snapshot 7ff9ed67-943a-4817-a43a-88ff5d9e42b8 {{(pid=91663) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-quobyte-4c6aa5e2-5469-415c-8483-9b5346c3e318" by "_copy_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b0dbdd-abff-4e2f-88c0-c2df2020cbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0722bf43-5238-48ea-8544-b5df719ea717', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166a2d40-bd64-43ca-a22c-3bcbf4ee3a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-4c6aa5e2-5469-415c-8483-9b5346c3e318" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] snapshot: 7ff9ed67-943a-4817-a43a-88ff5d9e42b8, volume: 4c6aa5e2-5469-415c-8483-9b5346c3e318,  {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 18 11:37:00 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Volume volume-0722bf43-5238-48ea-8544-b5df719ea717 (0722bf43-5238-48ea-8544-b5df719ea717): created successfully
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166a2d40-bd64-43ca-a22c-3bcbf4ee3a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Flow 'volume_create_manager' (bf2365a5-ef5c-4978-b38c-5cfde948d533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:00 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-c403467d-be00-4e46-ab5e-0402c4ae4248 tempest-VolumesListAdminTestJSON-1559372753 None] Created volume successfully.
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b311800-dc98-412c-996c-4b832043d682]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "cinder-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:00 devstack sudo[103759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8
Jun 18 11:37:00 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "cinder-quobyte-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9" acquired by "delete_volume" :: waited 0.018s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1722f57-ead8-485b-a2f0-cb21275dc376]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:00 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.726s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:37:00 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Deleted volume successfully.
Jun 18 11:37:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e0184021-9954-42b4-aa87-55ef77de9cf7 tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-5a26d2f5-7d60-468a-bbbe-5c0b430d60f3-delete_volume" released by "delete_volume" :: held 5.729s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:00 devstack sudo[103762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9
Jun 18 11:37:00 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:01 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8" returned: 0 in 0.868s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Creating direct copy from snapshot {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[90652bca-c78e-4920-9284-f210dbf450f3]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:01 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:01 devstack sudo[103772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f
Jun 18 11:37:01 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9" returned: 0 in 0.798s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:01 devstack sudo[103774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9
Jun 18 11:37:01 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Flow 'volume_create_manager' (92531f65-754b-4be2-bb16-c731419d261c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb15ae72-3048-41d0-991e-53838bdbcfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb15ae72-3048-41d0-991e-53838bdbcfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2004100542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62176a7-df5b-45d8-8f23-cacafab4909a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e67a2ff8155648ef9a7ffb010ddaf3f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:01Z,use_quota=True,user_id='c3c9b624b2264d459bda68102b67009b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6333529-e85c-4386-8830-619e379e05b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6333529-e85c-4386-8830-619e379e05b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a5beee-5f80-4b28-a423-fbfa0a4b1aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a5beee-5f80-4b28-a423-fbfa0a4b1aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd62176a7-df5b-45d8-8f23-cacafab4909a', 'volume_name': 'volume-d62176a7-df5b-45d8-8f23-cacafab4909a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0bd2cc-d17c-4c35-931f-e731b8b526b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0bd2cc-d17c-4c35-931f-e731b8b526b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff0cd00-a346-489a-9497-098beeda4c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:01 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Volume d62176a7-df5b-45d8-8f23-cacafab4909a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d62176a7-df5b-45d8-8f23-cacafab4909a', 'volume_size': 1}
Jun 18 11:37:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:02 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f" returned: 0 in 0.811s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:02 devstack cinder-volume[91663]: DEBUG cinder.utils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Path /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c6aa5e2-5469-415c-8483-9b5346c3e318 not found in is_blk_device check {{(pid=91663) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 18 11:37:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c6aa5e2-5469-415c-8483-9b5346c3e318 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:02 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9" returned: 0 in 0.720s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:02 devstack sudo[103781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c6aa5e2-5469-415c-8483-9b5346c3e318
Jun 18 11:37:02 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-quobyte-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9" released by "delete_volume" :: held 1.565s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:02 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] Created reservations ['d0dc414d-a73a-4daf-a150-d8e752a31693', 'd8f8e250-b492-444d-8880-b80cfb8f98bb', '8be8cf5a-4d1f-4372-8a17-37e2f93b052d', '79f55057-22fd-4033-b73f-ffb5bca6a46c'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:37:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:02 devstack sudo[103783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:37:02 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:02 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.697s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:02 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:37:02 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] Deleted volume successfully.
Jun 18 11:37:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1447295c-ee33-45a3-bcda-9522643e41b7 tempest-VolumesDeleteCascade-983906358 None] Lock "cinder-b34f62e8-bf9f-4c3b-a90d-e75209ef05b9-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:07 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c6aa5e2-5469-415c-8483-9b5346c3e318" returned: 0 in 5.283s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:07 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[6996be81-4975-4101-92e4-6b0c53760b32]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:07 devstack sudo[103807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f
Jun 18 11:37:07 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:08 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f" returned: 0 in 0.951s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:08 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c6aa5e2-5469-415c-8483-9b5346c3e318 {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:37:08 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Converted 1024.00 MB image at 193.80 MB/s
Jun 18 11:37:08 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c6aa5e2-5469-415c-8483-9b5346c3e318 is being set with open permissions: ugo+rw
Jun 18 11:37:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c6aa5e2-5469-415c-8483-9b5346c3e318 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:08 devstack sudo[103812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c6aa5e2-5469-415c-8483-9b5346c3e318
Jun 18 11:37:08 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:08 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c6aa5e2-5469-415c-8483-9b5346c3e318" returned: 0 in 0.643s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:08 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-4c6aa5e2-5469-415c-8483-9b5346c3e318" released by "_copy_volume_from_snapshot" :: held 8.688s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:08 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-7ff9ed67-943a-4817-a43a-88ff5d9e42b8-4c6aa5e2-5469-415c-8483-9b5346c3e318" released by "_create_volume_from_snapshot" :: held 8.739s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.770s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.407s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2004100542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62176a7-df5b-45d8-8f23-cacafab4909a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e67a2ff8155648ef9a7ffb010ddaf3f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:01Z,use_quota=True,user_id='c3c9b624b2264d459bda68102b67009b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:37:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Creating volume d62176a7-df5b-45d8-8f23-cacafab4909a {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:37:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:37:08 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:37:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d62176a7-df5b-45d8-8f23-cacafab4909a 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:08 devstack sudo[103815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d62176a7-df5b-45d8-8f23-cacafab4909a 1073741824
Jun 18 11:37:08 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc75706-69d8-465f-ab0d-837895b918e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c6aa5e2-5469-415c-8483-9b5346c3e318', 'volume_size': 2, 'snapshot_id': '7ff9ed67-943a-4817-a43a-88ff5d9e42b8'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc5fec1-cec1-4e24-8ab8-90d226067827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:09 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Volume volume-4c6aa5e2-5469-415c-8483-9b5346c3e318 (4c6aa5e2-5469-415c-8483-9b5346c3e318): created successfully
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc5fec1-cec1-4e24-8ab8-90d226067827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Flow 'volume_create_manager' (87c48ca5-dada-45f0-bc10-bf61788a2d89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:09 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-fb307135-856b-4cbe-b5e7-e480d3567373 tempest-VolumesSnapshotTestJSON-1640399948 None] Created volume successfully.
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Flow 'volume_create_manager' (73d822e0-e0c7-408d-be43-967ee1dd87f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1dfb3c7-4912-4fd2-9b2b-99c9f3298066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1dfb3c7-4912-4fd2-9b2b-99c9f3298066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-240670048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69579699-82e8-4fee-a160-a1e7406cc414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17664c334e345b59dbfc20debd32247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:10Z,use_quota=True,user_id='71393bd6c51e4867a8ea1f9b17c7c6b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eecee0f4-143f-40ab-9d6d-a82db60db89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eecee0f4-143f-40ab-9d6d-a82db60db89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6468868-0945-48ba-a798-a271413d1baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6468868-0945-48ba-a798-a271413d1baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69579699-82e8-4fee-a160-a1e7406cc414', 'volume_name': 'volume-69579699-82e8-4fee-a160-a1e7406cc414', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2ff8b7-a7cb-4eff-bdfb-b6357a54a36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2ff8b7-a7cb-4eff-bdfb-b6357a54a36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88b4f3f-c971-4696-ac2b-895b9de355ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:09 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Volume 69579699-82e8-4fee-a160-a1e7406cc414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69579699-82e8-4fee-a160-a1e7406cc414', 'volume_size': 1}
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:09 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d62176a7-df5b-45d8-8f23-cacafab4909a 1073741824" returned: 0 in 0.841s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d62176a7-df5b-45d8-8f23-cacafab4909a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:09 devstack sudo[103822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d62176a7-df5b-45d8-8f23-cacafab4909a
Jun 18 11:37:09 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-4c6aa5e2-5469-415c-8483-9b5346c3e318-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-4c6aa5e2-5469-415c-8483-9b5346c3e318-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-quobyte-4c6aa5e2-5469-415c-8483-9b5346c3e318" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-4c6aa5e2-5469-415c-8483-9b5346c3e318" acquired by "delete_volume" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[304aeed1-8154-4106-8502-25f1a7a5cef7]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c6aa5e2-5469-415c-8483-9b5346c3e318 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:10 devstack sudo[103824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c6aa5e2-5469-415c-8483-9b5346c3e318
Jun 18 11:37:10 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:10 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d62176a7-df5b-45d8-8f23-cacafab4909a" returned: 0 in 0.662s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.794s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-240670048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69579699-82e8-4fee-a160-a1e7406cc414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17664c334e345b59dbfc20debd32247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:10Z,use_quota=True,user_id='71393bd6c51e4867a8ea1f9b17c7c6b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Creating volume 69579699-82e8-4fee-a160-a1e7406cc414 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:37:10 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-69579699-82e8-4fee-a160-a1e7406cc414 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:10 devstack sudo[103827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-69579699-82e8-4fee-a160-a1e7406cc414 1073741824
Jun 18 11:37:10 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff0cd00-a346-489a-9497-098beeda4c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d62176a7-df5b-45d8-8f23-cacafab4909a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e48634-25ec-4670-b745-6d61aac04b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:10 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Volume volume-d62176a7-df5b-45d8-8f23-cacafab4909a (d62176a7-df5b-45d8-8f23-cacafab4909a): created successfully
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e48634-25ec-4670-b745-6d61aac04b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Flow 'volume_create_manager' (92531f65-754b-4be2-bb16-c731419d261c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:10 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-91213c97-5e20-49a4-adc0-3e39b6326d7b tempest-VolumesListAdminTestJSON-1559372753 None] Created volume successfully.
Jun 18 11:37:10 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c6aa5e2-5469-415c-8483-9b5346c3e318" returned: 0 in 0.766s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c6aa5e2-5469-415c-8483-9b5346c3e318 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:10 devstack sudo[103832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c6aa5e2-5469-415c-8483-9b5346c3e318
Jun 18 11:37:10 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:11 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-69579699-82e8-4fee-a160-a1e7406cc414 1073741824" returned: 0 in 0.847s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-69579699-82e8-4fee-a160-a1e7406cc414 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:11 devstack sudo[103839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-69579699-82e8-4fee-a160-a1e7406cc414
Jun 18 11:37:11 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:11 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c6aa5e2-5469-415c-8483-9b5346c3e318" returned: 0 in 0.649s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-4c6aa5e2-5469-415c-8483-9b5346c3e318" released by "delete_volume" :: held 1.462s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:11 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] Created reservations ['c4520260-a38a-4798-9e84-fa1546543107', 'b477340a-45d1-4c81-9dbf-af0afa54dbfa', '686ab4d9-0586-4332-b1a8-31c3ba6a3e5d', '0c406986-ae0c-4d05-9f77-1ac3244b2aad'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:37:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:11 devstack sudo[103841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:37:11 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:11 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:37:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Flow 'volume_create_manager' (bf08607b-46ad-4830-8e73-5c37dbcd9795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b77b45-61c2-457f-8cc8-adfc730f2bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b77b45-61c2-457f-8cc8-adfc730f2bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-265235350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e67a2ff8155648ef9a7ffb010ddaf3f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:12Z,use_quota=True,user_id='c3c9b624b2264d459bda68102b67009b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54cbf22-7379-478e-b3ae-781473a94312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54cbf22-7379-478e-b3ae-781473a94312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c348d845-c71d-405d-8ba0-bdc16cb73f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c348d845-c71d-405d-8ba0-bdc16cb73f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6', 'volume_name': 'volume-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da914c8-7b25-4b46-84e5-4a37d817b97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da914c8-7b25-4b46-84e5-4a37d817b97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e40b69-f3dc-4521-ab2f-ffb51f05d2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:12 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Volume d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6', 'volume_size': 1}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:12 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-69579699-82e8-4fee-a160-a1e7406cc414" returned: 0 in 0.678s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.049s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-265235350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e67a2ff8155648ef9a7ffb010ddaf3f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:12Z,use_quota=True,user_id='c3c9b624b2264d459bda68102b67009b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Creating volume d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:37:12 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88b4f3f-c971-4696-ac2b-895b9de355ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69579699-82e8-4fee-a160-a1e7406cc414', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:12 devstack sudo[103844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6 1073741824
Jun 18 11:37:12 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359a450b-0402-4c06-b4ce-adefb2207924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:12 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Volume volume-69579699-82e8-4fee-a160-a1e7406cc414 (69579699-82e8-4fee-a160-a1e7406cc414): created successfully
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359a450b-0402-4c06-b4ce-adefb2207924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Flow 'volume_create_manager' (73d822e0-e0c7-408d-be43-967ee1dd87f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:12 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-abd701f2-bce2-4351-8988-53a9ecc73cf0 tempest-VolumesTransfersTest-546685832 None] Created volume successfully.
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-7ff9ed67-943a-4817-a43a-88ff5d9e42b8-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-7ff9ed67-943a-4817-a43a-88ff5d9e42b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-quobyte-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-quobyte-7ff9ed67-943a-4817-a43a-88ff5d9e42b8" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-7ff9ed67-943a-4817-a43a-88ff5d9e42b8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] Deleting offline snapshot 7ff9ed67-943a-4817-a43a-88ff5d9e42b8 of volume 5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] snapshot_file for this snap is: volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dda657-2b35-47de-82cb-8ce429345249]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:12 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.765s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:37:12 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] Deleted volume successfully.
Jun 18 11:37:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4375699b-436f-4382-8e6a-f468b313b8c1 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-4c6aa5e2-5469-415c-8483-9b5346c3e318-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:12 devstack sudo[103847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8
Jun 18 11:37:12 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:13 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6 1073741824" returned: 0 in 0.961s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:13 devstack sudo[103856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6
Jun 18 11:37:13 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:13 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8" returned: 0 in 0.794s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:37:13 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5d8ddd-2f56-4ae9-bc78-b5beaa833ab9]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:13 devstack sudo[103858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f
Jun 18 11:37:13 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:13 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-b337efa1-8144-4f25-8f51-cfc289b8b8d1 tempest-VolumesTransfersTest-1279211354 None] Transfer volume completed successfully.
Jun 18 11:37:13 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6" returned: 0 in 0.690s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:37:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e40b69-f3dc-4521-ab2f-ffb51f05d2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b309ece9-216f-4646-b016-929ad1e34e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:13 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Volume volume-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6 (d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6): created successfully
Jun 18 11:37:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b309ece9-216f-4646-b016-929ad1e34e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Flow 'volume_create_manager' (bf08607b-46ad-4830-8e73-5c37dbcd9795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:13 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-8d3fdea2-ece6-42db-a8e2-08f16d089cad tempest-VolumesListAdminTestJSON-1559372753 None] Created volume successfully.
Jun 18 11:37:13 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f" returned: 0 in 0.775s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:14 devstack sudo[103864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8
Jun 18 11:37:14 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] Acquiring lock "cinder-69579699-82e8-4fee-a160-a1e7406cc414-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] Lock "cinder-69579699-82e8-4fee-a160-a1e7406cc414-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] Acquiring lock "cinder-quobyte-69579699-82e8-4fee-a160-a1e7406cc414" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] Lock "cinder-quobyte-69579699-82e8-4fee-a160-a1e7406cc414" acquired by "delete_volume" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca76d9d2-e790-4246-877a-b45faca2f722]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-69579699-82e8-4fee-a160-a1e7406cc414 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:14 devstack sudo[103866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-69579699-82e8-4fee-a160-a1e7406cc414
Jun 18 11:37:14 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:37:14 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Flow 'volume_create_manager' (b3174312-3a6f-4af5-b2e3-cc31d59ae26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdde9f0d-317e-411a-a97d-dc572f85d204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8" returned: 0 in 0.874s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:14 devstack sudo[103871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdde9f0d-317e-411a-a97d-dc572f85d204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e869f714-413a-4840-b835-eca7acbc23fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3225a88740754a7796bc6cc2e6ba032d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:15Z,use_quota=True,user_id='268b88d4f4bf4fce9a7cc853ae16ab8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:14 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc78eda-a775-447e-8f0f-99d4d9c3b851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc78eda-a775-447e-8f0f-99d4d9c3b851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fe03c8-32c2-40c9-80c2-faad7ccc9fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fe03c8-32c2-40c9-80c2-faad7ccc9fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e869f714-413a-4840-b835-eca7acbc23fb', 'volume_name': 'volume-e869f714-413a-4840-b835-eca7acbc23fb', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ef4ca5-b024-47f3-a327-9a5fb8b9526c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ef4ca5-b024-47f3-a327-9a5fb8b9526c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22485f28-6078-4c46-ba8b-5c08e3a52fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:14 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Volume e869f714-413a-4840-b835-eca7acbc23fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e869f714-413a-4840-b835-eca7acbc23fb', 'volume_size': 1}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e869f714-413a-4840-b835-eca7acbc23fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3225a88740754a7796bc6cc2e6ba032d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:15Z,use_quota=True,user_id='268b88d4f4bf4fce9a7cc853ae16ab8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Creating volume e869f714-413a-4840-b835-eca7acbc23fb {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:37:14 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:37:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e869f714-413a-4840-b835-eca7acbc23fb 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:14 devstack sudo[103873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e869f714-413a-4840-b835-eca7acbc23fb 1073741824
Jun 18 11:37:14 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:15 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-69579699-82e8-4fee-a160-a1e7406cc414" returned: 0 in 0.804s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-69579699-82e8-4fee-a160-a1e7406cc414 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:15 devstack sudo[103878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-69579699-82e8-4fee-a160-a1e7406cc414
Jun 18 11:37:15 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:15 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f.7ff9ed67-943a-4817-a43a-88ff5d9e42b8" returned: 0 in 0.665s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-7ff9ed67-943a-4817-a43a-88ff5d9e42b8" released by "_delete_snapshot" :: held 3.230s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f" released by "delete_snapshot" :: held 3.262s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:15 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] Created reservations ['829f78ba-12cb-4b90-9326-ce2cfd0790fc', '1e130763-8357-4960-9528-57353b7c6147', 'fc701210-9355-4c3b-a43a-4cb5789c8e61', '3d350a91-980e-4e2e-b78f-c795c7c350d8'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:37:15 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] Delete snapshot completed successfully.
Jun 18 11:37:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f44c3da8-b7de-4fce-943a-fc5811031a33 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-7ff9ed67-943a-4817-a43a-88ff5d9e42b8-delete_snapshot" released by "delete_snapshot" :: held 3.413s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:15 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e869f714-413a-4840-b835-eca7acbc23fb 1073741824" returned: 0 in 0.924s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e869f714-413a-4840-b835-eca7acbc23fb {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:15 devstack sudo[103885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e869f714-413a-4840-b835-eca7acbc23fb
Jun 18 11:37:15 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:16 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-69579699-82e8-4fee-a160-a1e7406cc414" returned: 0 in 0.688s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] Lock "cinder-quobyte-69579699-82e8-4fee-a160-a1e7406cc414" released by "delete_volume" :: held 1.551s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] Created reservations ['882c6beb-6f66-4b14-8ab9-337a6c35188d', '4cde40b0-b940-4dbb-8deb-1888654b7c2b', '3954f32b-c5b2-4498-9e3e-9a6bf1d566d1', 'b5fdfad1-7b2a-4fce-894d-c3318f06edb3'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:16 devstack sudo[103888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:37:16 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:16 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e869f714-413a-4840-b835-eca7acbc23fb" returned: 0 in 0.648s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22485f28-6078-4c46-ba8b-5c08e3a52fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e869f714-413a-4840-b835-eca7acbc23fb', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00156cd-cd72-4608-9b32-945520503c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:16 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Volume volume-e869f714-413a-4840-b835-eca7acbc23fb (e869f714-413a-4840-b835-eca7acbc23fb): created successfully
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00156cd-cd72-4608-9b32-945520503c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Flow 'volume_create_manager' (b3174312-3a6f-4af5-b2e3-cc31d59ae26f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:16 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-04beb99c-448a-495d-ac1c-1dc36f2a70a0 tempest-VolumesListAdminTestJSON-1415528582 None] Created volume successfully.
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-quobyte-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f" acquired by "delete_volume" :: waited 0.029s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15e47cd-f36b-4820-958f-02b425be8254]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:16 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.665s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:37:16 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] Deleted volume successfully.
Jun 18 11:37:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f13156b5-ae8f-4104-b35a-47c8f2f027ba tempest-VolumesTransfersTest-1180479336 None] Lock "cinder-69579699-82e8-4fee-a160-a1e7406cc414-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:16 devstack sudo[103892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f
Jun 18 11:37:16 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] Acquiring lock "cinder-e869f714-413a-4840-b835-eca7acbc23fb-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] Lock "cinder-e869f714-413a-4840-b835-eca7acbc23fb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] Acquiring lock "cinder-quobyte-e869f714-413a-4840-b835-eca7acbc23fb" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] Lock "cinder-quobyte-e869f714-413a-4840-b835-eca7acbc23fb" acquired by "delete_volume" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e22e79c-13b3-44b0-a77d-5f89c0674206]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e869f714-413a-4840-b835-eca7acbc23fb {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] Acquiring lock "cinder-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "cinder-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] Acquiring lock "cinder-quobyte-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "cinder-quobyte-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6" acquired by "delete_volume" :: waited 0.026s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:17 devstack sudo[103894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e869f714-413a-4840-b835-eca7acbc23fb
Jun 18 11:37:17 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[9272c06d-d224-478d-a23e-1c18d13788a2]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Flow 'volume_create_manager' (1be310f9-208e-4eaf-a8f7-a7474c350455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278395ae-67e6-4df2-a0b4-efd719e0e218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278395ae-67e6-4df2-a0b4-efd719e0e218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1083916234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76ad041-5ae3-412b-b061-544c3261c76a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17664c334e345b59dbfc20debd32247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:17Z,use_quota=True,user_id='71393bd6c51e4867a8ea1f9b17c7c6b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23cd9b95-c6b3-4176-a992-d416db87e038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23cd9b95-c6b3-4176-a992-d416db87e038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f366a9-a394-49de-99dc-bc48fc105e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f366a9-a394-49de-99dc-bc48fc105e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c76ad041-5ae3-412b-b061-544c3261c76a', 'volume_name': 'volume-c76ad041-5ae3-412b-b061-544c3261c76a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c850c5-3d0f-4dab-82fe-8e34378af01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c850c5-3d0f-4dab-82fe-8e34378af01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160e973f-0451-4a97-a370-55c1abb7a9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:17 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Volume c76ad041-5ae3-412b-b061-544c3261c76a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c76ad041-5ae3-412b-b061-544c3261c76a', 'volume_size': 1}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1083916234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76ad041-5ae3-412b-b061-544c3261c76a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17664c334e345b59dbfc20debd32247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:17Z,use_quota=True,user_id='71393bd6c51e4867a8ea1f9b17c7c6b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Creating volume c76ad041-5ae3-412b-b061-544c3261c76a {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:37:17 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76ad041-5ae3-412b-b061-544c3261c76a 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:17 devstack sudo[103896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6
Jun 18 11:37:17 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:17 devstack sudo[103897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76ad041-5ae3-412b-b061-544c3261c76a 1073741824
Jun 18 11:37:17 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:17 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f" returned: 0 in 0.975s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:17 devstack sudo[103904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f
Jun 18 11:37:17 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:18 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e869f714-413a-4840-b835-eca7acbc23fb" returned: 0 in 0.861s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e869f714-413a-4840-b835-eca7acbc23fb {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:18 devstack sudo[103910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e869f714-413a-4840-b835-eca7acbc23fb
Jun 18 11:37:18 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:18 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6" returned: 0 in 0.880s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:18 devstack sudo[103919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6
Jun 18 11:37:18 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:18 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76ad041-5ae3-412b-b061-544c3261c76a 1073741824" returned: 0 in 0.961s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:18 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f" returned: 0 in 0.739s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76ad041-5ae3-412b-b061-544c3261c76a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f" released by "delete_volume" :: held 1.793s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:18 devstack sudo[103922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76ad041-5ae3-412b-b061-544c3261c76a
Jun 18 11:37:18 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] Created reservations ['51f6a6b4-9d91-4d05-8d8f-59cc3c9068f2', '2e13da4a-cf77-423e-947a-13048e9e699d', '1c4c4c7e-5508-4616-a07c-df774055bac9', 'aaf6bbde-9797-44cf-806c-4ea911dc566f'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:18 devstack sudo[103924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:37:18 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:18 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e869f714-413a-4840-b835-eca7acbc23fb" returned: 0 in 0.814s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] Lock "cinder-quobyte-e869f714-413a-4840-b835-eca7acbc23fb" released by "delete_volume" :: held 1.753s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:18 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] Created reservations ['a50e7439-e93d-4a73-ad68-6dbea3534c4d', 'b10c4053-f132-4303-a9ba-771f600832d6', '22560a5f-28fa-4f4b-b33c-0980b420fdcb', '14523be3-defe-4a5d-8535-1b7dc359dadd'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:19 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6" returned: 0 in 0.873s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:19 devstack sudo[103928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:37:19 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "cinder-quobyte-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6" released by "delete_volume" :: held 1.818s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] Created reservations ['782d9f67-9cf0-4326-9200-bb2cc2764ac6', '74d92a08-aa5e-44a2-ace5-3a5fa3770e12', 'af19efed-8b23-44b4-acf7-8515cfd21b9b', 'c6377597-120f-4128-abdb-2d66278cb57c'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:19 devstack sudo[103931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:37:19 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:19 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76ad041-5ae3-412b-b061-544c3261c76a" returned: 0 in 0.843s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160e973f-0451-4a97-a370-55c1abb7a9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76ad041-5ae3-412b-b061-544c3261c76a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9777e4ee-3a12-45a8-832f-8a0ae3c1a768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:19 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Volume volume-c76ad041-5ae3-412b-b061-544c3261c76a (c76ad041-5ae3-412b-b061-544c3261c76a): created successfully
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9777e4ee-3a12-45a8-832f-8a0ae3c1a768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Flow 'volume_create_manager' (1be310f9-208e-4eaf-a8f7-a7474c350455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:19 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-aff620c4-9b94-479a-9741-20d0214dfa44 tempest-VolumesTransfersTest-546685832 None] Created volume successfully.
Jun 18 11:37:19 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.898s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:37:19 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] Deleted volume successfully.
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-426b8f1d-ed14-452f-a918-0b1ee2c2b402 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-5a573ae6-1496-4dcb-9e3b-4ca1fa1e689f-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] Acquiring lock "cinder-d62176a7-df5b-45d8-8f23-cacafab4909a-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "cinder-d62176a7-df5b-45d8-8f23-cacafab4909a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] Acquiring lock "cinder-quobyte-d62176a7-df5b-45d8-8f23-cacafab4909a" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "cinder-quobyte-d62176a7-df5b-45d8-8f23-cacafab4909a" acquired by "delete_volume" :: waited 0.037s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Flow 'volume_create_manager' (318339fa-8a21-4e21-bd5e-68a017bf9473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e010c573-c97d-4ec8-8c2b-774c1ad6266b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccdf2a5-261e-4f46-9c4a-671e234a9943]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d62176a7-df5b-45d8-8f23-cacafab4909a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e010c573-c97d-4ec8-8c2b-774c1ad6266b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-756509948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abcc72da-569c-4d87-be7c-5bd1c2b3df6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfec25c6afed4b548197b853fe22fc8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:20Z,use_quota=True,user_id='99725248d5404ca482f98c979ae41578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123b5202-b9fa-4fba-8d99-10eedea200d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123b5202-b9fa-4fba-8d99-10eedea200d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df246a83-e6bb-4fa8-9153-240ff9a2060b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df246a83-e6bb-4fa8-9153-240ff9a2060b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abcc72da-569c-4d87-be7c-5bd1c2b3df6a', 'volume_name': 'volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72984a6b-97fe-4190-a581-ae54c1477d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72984a6b-97fe-4190-a581-ae54c1477d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929e9c40-4889-434b-8c7c-1f1a0ea02d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:19 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Volume abcc72da-569c-4d87-be7c-5bd1c2b3df6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a', 'volume_size': 1}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-756509948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abcc72da-569c-4d87-be7c-5bd1c2b3df6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfec25c6afed4b548197b853fe22fc8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:20Z,use_quota=True,user_id='99725248d5404ca482f98c979ae41578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Creating volume abcc72da-569c-4d87-be7c-5bd1c2b3df6a {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:37:19 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:37:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:19 devstack sudo[103937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a 1073741824
Jun 18 11:37:19 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:19 devstack sudo[103935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d62176a7-df5b-45d8-8f23-cacafab4909a
Jun 18 11:37:19 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:20 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.858s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:20 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:37:20 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] Deleted volume successfully.
Jun 18 11:37:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3a85d297-5728-4579-b055-0d9f43127a86 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "cinder-d3e442c1-4b4b-4ec4-ae33-1d4f1435f4f6-delete_volume" released by "delete_volume" :: held 2.947s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:20 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.112s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:20 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:37:20 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] Deleted volume successfully.
Jun 18 11:37:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f0d8c6ef-326f-4464-a1bc-4b95cc9f5d90 tempest-VolumesListAdminTestJSON-1415528582 None] Lock "cinder-e869f714-413a-4840-b835-eca7acbc23fb-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:20 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d62176a7-df5b-45d8-8f23-cacafab4909a" returned: 0 in 0.977s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d62176a7-df5b-45d8-8f23-cacafab4909a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] Acquiring lock "cinder-c76ad041-5ae3-412b-b061-544c3261c76a-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:20 devstack sudo[103985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d62176a7-df5b-45d8-8f23-cacafab4909a
Jun 18 11:37:20 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] Lock "cinder-c76ad041-5ae3-412b-b061-544c3261c76a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] Acquiring lock "cinder-quobyte-c76ad041-5ae3-412b-b061-544c3261c76a" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] Lock "cinder-quobyte-c76ad041-5ae3-412b-b061-544c3261c76a" acquired by "delete_volume" :: waited 0.018s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:20 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:20 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafcfafe-8112-4d14-9399-03513c78acdf]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76ad041-5ae3-412b-b061-544c3261c76a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a 1073741824" returned: 0 in 1.085s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:21 devstack sudo[103988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a
Jun 18 11:37:21 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:21 devstack sudo[103987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76ad041-5ae3-412b-b061-544c3261c76a
Jun 18 11:37:21 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:21 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d62176a7-df5b-45d8-8f23-cacafab4909a" returned: 0 in 0.711s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "cinder-quobyte-d62176a7-df5b-45d8-8f23-cacafab4909a" released by "delete_volume" :: held 1.762s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] Created reservations ['e269ec23-0008-4899-9970-f886a82527ce', '62aeb933-10c3-43a7-a0ea-d8fb004b9f4c', '04556049-d29e-4123-b7ef-1835c28e0ff1', '504be90e-a6cc-4748-8e9e-b2a50fbdbdc3'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:21 devstack sudo[103997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:37:21 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:21 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a" returned: 0 in 0.669s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929e9c40-4889-434b-8c7c-1f1a0ea02d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b5682f-5cd2-4058-950d-bf234e2bf8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:21 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Volume volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a (abcc72da-569c-4d87-be7c-5bd1c2b3df6a): created successfully
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b5682f-5cd2-4058-950d-bf234e2bf8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Flow 'volume_create_manager' (318339fa-8a21-4e21-bd5e-68a017bf9473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:21 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:21 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-7f12963d-588e-4996-bc4a-254b343cfaf1 tempest-VolumesSnapshotTestJSON-1640399948 None] Created volume successfully.
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76ad041-5ae3-412b-b061-544c3261c76a" returned: 0 in 0.785s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76ad041-5ae3-412b-b061-544c3261c76a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:21 devstack sudo[103999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76ad041-5ae3-412b-b061-544c3261c76a
Jun 18 11:37:21 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] Acquiring lock "cinder-0722bf43-5238-48ea-8544-b5df719ea717-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "cinder-0722bf43-5238-48ea-8544-b5df719ea717-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] Acquiring lock "cinder-quobyte-0722bf43-5238-48ea-8544-b5df719ea717" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "cinder-quobyte-0722bf43-5238-48ea-8544-b5df719ea717" acquired by "delete_volume" :: waited 0.026s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] Creating offline snapshot 53c6d6e3-dfef-48f4-a664-5023119c13de of volume abcc72da-569c-4d87-be7c-5bd1c2b3df6a {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[845d7103-6360-4e4a-81e9-0246d1d4fb81]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0722bf43-5238-48ea-8544-b5df719ea717 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae18abd1-fa25-45ea-9562-d2283e804a68]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:22 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.713s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:37:22 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] Deleted volume successfully.
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fa63884f-a494-41b2-9337-7928e9ea2886 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "cinder-d62176a7-df5b-45d8-8f23-cacafab4909a-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:22 devstack sudo[104002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0722bf43-5238-48ea-8544-b5df719ea717
Jun 18 11:37:22 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:22 devstack sudo[104003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a
Jun 18 11:37:22 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:22 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c76ad041-5ae3-412b-b061-544c3261c76a" returned: 0 in 0.724s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] Lock "cinder-quobyte-c76ad041-5ae3-412b-b061-544c3261c76a" released by "delete_volume" :: held 1.560s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] Created reservations ['c3457338-dd27-4d24-abf0-be181c1aca9d', '94700407-b699-436f-b457-553fbedca261', '2dc561cc-2431-4a48-8849-aa65659fa05b', '0835eab4-aa82-4863-8ba6-d93bcd977616'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:22 devstack sudo[104007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:37:22 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:23 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0722bf43-5238-48ea-8544-b5df719ea717" returned: 0 in 0.822s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0722bf43-5238-48ea-8544-b5df719ea717 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:23 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a" returned: 0 in 0.847s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:23 devstack sudo[104015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0722bf43-5238-48ea-8544-b5df719ea717
Jun 18 11:37:23 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:23 devstack sudo[104017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de 1G
Jun 18 11:37:23 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:23 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.742s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:23 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:37:23 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] Deleted volume successfully.
Jun 18 11:37:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-84e16730-7bb7-4c70-859f-3fc691472201 tempest-VolumesTransfersTest-1180479336 None] Lock "cinder-c76ad041-5ae3-412b-b061-544c3261c76a-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:23 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0722bf43-5238-48ea-8544-b5df719ea717" returned: 0 in 0.721s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "cinder-quobyte-0722bf43-5238-48ea-8544-b5df719ea717" released by "delete_volume" :: held 1.591s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:23 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] Created reservations ['a90c6c6c-00bb-4bfa-8aa4-eb270cdb50ad', 'fa74dee7-bec0-44f0-b207-7b809b76e3d9', '4d0b773f-aae4-4ece-9566-18b09ffe545b', 'a0b51ade-4f1d-4c9d-b9de-a86483b20fbd'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:37:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:24 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:24 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:24 devstack sudo[104026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:37:24 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:24 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de 1G" returned: 0 in 0.902s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:24 devstack sudo[104028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de
Jun 18 11:37:24 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:24 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.775s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:24 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:37:24 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] Deleted volume successfully.
Jun 18 11:37:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e4693de1-4279-4757-8e0b-b36877d88e65 tempest-VolumesListAdminTestJSON-1559372753 None] Lock "cinder-0722bf43-5238-48ea-8544-b5df719ea717-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:24 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de" returned: 0 in 0.892s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:24 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de is being set with open permissions: ugo+rw
Jun 18 11:37:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:25 devstack sudo[104035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de
Jun 18 11:37:25 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:37:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:25 devstack sudo[104037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:37:25 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:25 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de" returned: 0 in 0.957s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:26 devstack sudo[104040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.info
Jun 18 11:37:26 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:26 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.822s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:37:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:37:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:37:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:37:26 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.info" returned: 0 in 0.845s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:26 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.info is being set with open permissions: ugo+rw
Jun 18 11:37:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:26 devstack sudo[104044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.info
Jun 18 11:37:26 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:27 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.info" returned: 0 in 0.824s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.394s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:27 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-955cb16f-0a8d-4d83-814e-be313b677060 tempest-VolumesSnapshotTestJSON-1640399948 None] Create snapshot completed successfully
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Flow 'volume_create_manager' (bfbf2d48-40e9-4b65-a006-4f8c33e885a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871f7c4e-e679-49a1-ae03-1d91cba4df1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871f7c4e-e679-49a1-ae03-1d91cba4df1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1264705468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cdc92c0-396f-47c2-9e6e-8fcddc9f3262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfec25c6afed4b548197b853fe22fc8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=53c6d6e3-dfef-48f4-a664-5023119c13de,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:29Z,use_quota=True,user_id='99725248d5404ca482f98c979ae41578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7614f78e-5c36-4933-962c-2745911dfc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7614f78e-5c36-4933-962c-2745911dfc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd2285c-6d90-430d-b3bc-c40a43a86675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd2285c-6d90-430d-b3bc-c40a43a86675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6cdc92c0-396f-47c2-9e6e-8fcddc9f3262', 'volume_name': 'volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262', 'volume_size': 1, 'snapshot_id': '53c6d6e3-dfef-48f4-a664-5023119c13de'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace85951-1fa8-4f76-abf4-2352563310db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace85951-1fa8-4f76-abf4-2352563310db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7677b3c6-c12a-4c07-a02f-90d3c91e5e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:29 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Volume 6cdc92c0-396f-47c2-9e6e-8fcddc9f3262: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262', 'volume_size': 1, 'snapshot_id': '53c6d6e3-dfef-48f4-a664-5023119c13de'}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-quobyte-53c6d6e3-dfef-48f4-a664-5023119c13de-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262" by "_create_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-53c6d6e3-dfef-48f4-a664-5023119c13de-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Creating volume 6cdc92c0-396f-47c2-9e6e-8fcddc9f3262 from snapshot 53c6d6e3-dfef-48f4-a664-5023119c13de {{(pid=91663) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-quobyte-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262" by "_copy_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] snapshot: 53c6d6e3-dfef-48f4-a664-5023119c13de, volume: 6cdc92c0-396f-47c2-9e6e-8fcddc9f3262,  {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Flow 'volume_create_manager' (4e2583dc-c62f-4cfb-9da0-9070d0683b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ae5b92-107c-4b07-8110-1e9b0e12c15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aafcfa1-e35a-483e-9f78-8799a3325ef8]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ae5b92-107c-4b07-8110-1e9b0e12c15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1405637249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae24f431bb784ed8b65944833dad7bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:29Z,use_quota=True,user_id='f0ac062ab367457bbf19647dfb5052e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d707844-9901-42ed-b761-ef6bbac386d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d707844-9901-42ed-b761-ef6bbac386d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81141e1-926b-43bb-886f-6d1ed21aaacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81141e1-926b-43bb-886f-6d1ed21aaacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7', 'volume_name': 'volume-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39722bd-082b-42b8-9514-a94e6743e89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39722bd-082b-42b8-9514-a94e6743e89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246f314a-88eb-442d-9165-f6feeed62684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:29 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Volume ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7', 'volume_size': 1}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:29 devstack sudo[104047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de
Jun 18 11:37:29 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Flow 'volume_create_manager' (30faf4f8-8fe1-416c-bc66-e3e8123b57ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a4e67e-5e79-41ce-b32d-4b266aa62e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a4e67e-5e79-41ce-b32d-4b266aa62e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1837460408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9361db-be42-4708-b5c5-2951e228dd7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33077a7d56b44218bc6d179dd236bd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:30Z,use_quota=True,user_id='8bfa20ec98fe4d85814af78bc5d8e685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe8e60d-7eae-4a60-9ee0-762ac06b30df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe8e60d-7eae-4a60-9ee0-762ac06b30df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491cf9be-cf47-4779-b7a4-a657f4514d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491cf9be-cf47-4779-b7a4-a657f4514d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec9361db-be42-4708-b5c5-2951e228dd7e', 'volume_name': 'volume-ec9361db-be42-4708-b5c5-2951e228dd7e', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27123d69-eebd-461f-af1e-3ba6801dd8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27123d69-eebd-461f-af1e-3ba6801dd8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e53288-6cec-42fc-9965-a783704b9961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:29 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Volume ec9361db-be42-4708-b5c5-2951e228dd7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec9361db-be42-4708-b5c5-2951e228dd7e', 'volume_size': 1}
Jun 18 11:37:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:30 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de" returned: 0 in 0.791s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:30 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:37:30 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 18 11:37:30 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Creating direct copy from snapshot {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 18 11:37:30 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[039f869e-c460-413c-89ea-d5d362ae4ca4]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:30 devstack sudo[104053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a
Jun 18 11:37:30 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:31 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a" returned: 0 in 0.750s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:31 devstack cinder-volume[91663]: DEBUG cinder.utils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Path /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262 not found in is_blk_device check {{(pid=91663) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 18 11:37:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:31 devstack sudo[104058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262
Jun 18 11:37:31 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:35 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262" returned: 0 in 4.528s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:35 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a27dc7-764b-4122-abc4-ffcf45bd92fe]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:35 devstack sudo[104071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a
Jun 18 11:37:35 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:36 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a" returned: 0 in 0.890s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:36 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a, size 1024.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262 {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:37:36 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Converted 1024.00 MB image at 226.11 MB/s
Jun 18 11:37:36 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262 is being set with open permissions: ugo+rw
Jun 18 11:37:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:36 devstack sudo[104076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262
Jun 18 11:37:36 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:37 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262" returned: 0 in 0.648s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262" released by "_copy_volume_from_snapshot" :: held 7.753s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-53c6d6e3-dfef-48f4-a664-5023119c13de-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262" released by "_create_volume_from_snapshot" :: held 7.810s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.836s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.592s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1405637249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae24f431bb784ed8b65944833dad7bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:29Z,use_quota=True,user_id='f0ac062ab367457bbf19647dfb5052e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Creating volume ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:37:37 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:37 devstack sudo[104079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7 1073741824
Jun 18 11:37:37 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7677b3c6-c12a-4c07-a02f-90d3c91e5e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262', 'volume_size': 1, 'snapshot_id': '53c6d6e3-dfef-48f4-a664-5023119c13de'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30756699-fd71-4288-93d5-1b8d32d6d68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:37 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Volume volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262 (6cdc92c0-396f-47c2-9e6e-8fcddc9f3262): created successfully
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30756699-fd71-4288-93d5-1b8d32d6d68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Flow 'volume_create_manager' (bfbf2d48-40e9-4b65-a006-4f8c33e885a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:37 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-65730af7-24f1-4a5b-a6ab-851e227e87d7 tempest-VolumesSnapshotTestJSON-1640399948 None] Created volume successfully.
Jun 18 11:37:37 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7 1073741824" returned: 0 in 0.802s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:38 devstack sudo[104085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7
Jun 18 11:37:38 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-quobyte-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262" acquired by "delete_volume" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[101edd57-e119-4ce6-8249-29e0697de9b1]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:38 devstack sudo[104087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262
Jun 18 11:37:38 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:38 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7" returned: 0 in 0.662s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.933s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1837460408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9361db-be42-4708-b5c5-2951e228dd7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33077a7d56b44218bc6d179dd236bd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:30Z,use_quota=True,user_id='8bfa20ec98fe4d85814af78bc5d8e685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Creating volume ec9361db-be42-4708-b5c5-2951e228dd7e {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:37:38 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:38 devstack sudo[104090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e 1073741824
Jun 18 11:37:38 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246f314a-88eb-442d-9165-f6feeed62684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac538344-217e-4270-8e74-2988580f978f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:38 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Volume volume-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7 (ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7): created successfully
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac538344-217e-4270-8e74-2988580f978f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Flow 'volume_create_manager' (4e2583dc-c62f-4cfb-9da0-9070d0683b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:UPDATE=140,cinder:DELETE=11,cinder:SELECT=109,cinder:INSERT=31 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:37:38 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-0cbbd6d6-249d-460e-9f91-a2bbbd399cc6 tempest-VolumesMetadataTest-1647316510 None] Created volume successfully.
Jun 18 11:37:38 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262" returned: 0 in 0.772s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:38 devstack sudo[104095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262
Jun 18 11:37:38 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:39 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e 1073741824" returned: 0 in 0.901s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:39 devstack sudo[104103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e
Jun 18 11:37:39 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:39 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262" returned: 0 in 0.762s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:39 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262" released by "delete_volume" :: held 1.590s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:39 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] Created reservations ['1bf66cdf-292b-4b7b-a206-235004aea189', '9ca147c0-4f6c-46a3-bd6e-c62131df92f2', '475ef0f0-fc8a-41f6-b96e-ef78461137ad', 'b9c2e356-665a-48d2-a5ee-5c30b020622e'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:37:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:39 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:39 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:39 devstack sudo[104105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:37:39 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:39 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] Acquiring lock "cinder-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:39 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] Lock "cinder-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:39 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] Acquiring lock "cinder-quobyte-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:39 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] Lock "cinder-quobyte-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7" acquired by "delete_volume" :: waited 0.023s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[141bc14e-acd9-40c5-99bb-a6d4818f47d1]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:40 devstack sudo[104107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7
Jun 18 11:37:40 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-53c6d6e3-dfef-48f4-a664-5023119c13de-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:40 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e" returned: 0 in 0.806s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-53c6d6e3-dfef-48f4-a664-5023119c13de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-quobyte-abcc72da-569c-4d87-be7c-5bd1c2b3df6a" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e53288-6cec-42fc-9965-a783704b9961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec9361db-be42-4708-b5c5-2951e228dd7e', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e78d3c-4049-49a8-8ef9-1dfbc06a6fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-abcc72da-569c-4d87-be7c-5bd1c2b3df6a" acquired by "delete_snapshot" :: waited 0.032s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-quobyte-53c6d6e3-dfef-48f4-a664-5023119c13de" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:40 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Volume volume-ec9361db-be42-4708-b5c5-2951e228dd7e (ec9361db-be42-4708-b5c5-2951e228dd7e): created successfully
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e78d3c-4049-49a8-8ef9-1dfbc06a6fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Flow 'volume_create_manager' (30faf4f8-8fe1-416c-bc66-e3e8123b57ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-53c6d6e3-dfef-48f4-a664-5023119c13de" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] Deleting offline snapshot 53c6d6e3-dfef-48f4-a664-5023119c13de of volume abcc72da-569c-4d87-be7c-5bd1c2b3df6a {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] snapshot_file for this snap is: volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:37:40 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-3a4961a8-3c09-444e-924a-2c310fdb78c8 tempest-VolumesCloneTest-435830861 None] Created volume successfully.
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[71da5b6c-5d2c-4f22-9d14-129b48fe729a]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:40 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.721s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:37:40 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] Deleted volume successfully.
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-13f18da0-a7d5-47a4-9ae7-1e398f487e17 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-6cdc92c0-396f-47c2-9e6e-8fcddc9f3262-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:40 devstack sudo[104111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de
Jun 18 11:37:40 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:40 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7" returned: 0 in 0.793s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:40 devstack sudo[104116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7
Jun 18 11:37:40 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:41 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de" returned: 0 in 0.766s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:37:41 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e25fa3-e922-497f-9f7e-1be69bdc21dc]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:41 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:41 devstack sudo[104122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a
Jun 18 11:37:41 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7" returned: 0 in 0.655s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] Lock "cinder-quobyte-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7" released by "delete_volume" :: held 1.497s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:41 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] Created reservations ['5c6406c9-d62c-4b05-b0a3-151122fd3e8d', '3927fcd5-a210-456e-8815-8f7082aaaf73', 'bdf31360-dbe3-4315-9dcf-b952b7d14bd0', 'fa6e21e8-8247-4904-9369-4952f7173127'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:37:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:41 devstack sudo[104124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:37:41 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Flow 'volume_create_manager' (2b433df4-a2c8-4be4-a025-0349a8031fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ebc152-e23d-4091-9133-db896d5904f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ebc152-e23d-4091-9133-db896d5904f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-378398039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084676b1-d20e-4052-a9fe-3e73756c6fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33077a7d56b44218bc6d179dd236bd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=ec9361db-be42-4708-b5c5-2951e228dd7e,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:42Z,use_quota=True,user_id='8bfa20ec98fe4d85814af78bc5d8e685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e430d28e-b430-47e6-aac8-7b533c066a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e430d28e-b430-47e6-aac8-7b533c066a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3918d293-ea2c-4284-a23f-d3e1810db87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3918d293-ea2c-4284-a23f-d3e1810db87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '084676b1-d20e-4052-a9fe-3e73756c6fea', 'volume_name': 'volume-084676b1-d20e-4052-a9fe-3e73756c6fea', 'volume_size': 2, 'source_volid': 'ec9361db-be42-4708-b5c5-2951e228dd7e', 'source_volstatus': 'available'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ff090f-8217-4ce4-812c-118aa2315bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ff090f-8217-4ce4-812c-118aa2315bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ceeedb-8371-48e2-ab6e-37b6e0bfb45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:42 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Volume 084676b1-d20e-4052-a9fe-3e73756c6fea: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-084676b1-d20e-4052-a9fe-3e73756c6fea', 'volume_size': 2, 'source_volid': 'ec9361db-be42-4708-b5c5-2951e228dd7e', 'source_volstatus': 'available'}
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:42 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Cloning volume ec9361db-be42-4708-b5c5-2951e228dd7e to volume 084676b1-d20e-4052-a9fe-3e73756c6fea
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Creating offline snapshot ff4c5460-b3d8-4a49-aad9-1bca6a568757 of volume ec9361db-be42-4708-b5c5-2951e228dd7e {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:37:42 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab219285-fbe4-40b1-ae05-8998578305de]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a" returned: 0 in 0.883s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:42 devstack sudo[104131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de
Jun 18 11:37:42 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:42 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.693s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:37:42 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] Deleted volume successfully.
Jun 18 11:37:42 devstack sudo[104130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e
Jun 18 11:37:42 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9e96b7b2-24ab-4e3e-ac88-86c60bb7c1e8 tempest-VolumesMetadataTest-1647316510 None] Lock "cinder-ef3c7fcb-fbb7-441e-904b-3ae38e5d37a7-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:42 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:43 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:43 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de" returned: 0 in 0.856s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e" returned: 0 in 0.881s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:43 devstack sudo[104142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de
Jun 18 11:37:43 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:43 devstack sudo[104143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757 1G
Jun 18 11:37:43 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:43 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a.53c6d6e3-dfef-48f4-a664-5023119c13de" returned: 0 in 0.688s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:43 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=110,cinder:UPDATE=150,cinder:DELETE=16,cinder:INSERT=35 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:37:43 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-53c6d6e3-dfef-48f4-a664-5023119c13de" released by "_delete_snapshot" :: held 3.322s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:43 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-abcc72da-569c-4d87-be7c-5bd1c2b3df6a" released by "delete_snapshot" :: held 3.365s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:43 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] Created reservations ['02d6a4e9-2bcd-4c85-a5a7-b4d881c2d82c', '18adc01c-e433-4475-885d-99b9b27792e6', '8bb790ae-d11d-44a2-81d8-9eadff63665e', '73f431c9-bed2-461c-aa26-037a65e3a49b'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:37:43 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] Delete snapshot completed successfully.
Jun 18 11:37:43 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0a5c78ed-8bfb-4739-a3b6-6701cd806ac0 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-53c6d6e3-dfef-48f4-a664-5023119c13de-delete_snapshot" released by "delete_snapshot" :: held 3.546s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:44 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757 1G" returned: 0 in 0.969s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec9361db-be42-4708-b5c5-2951e228dd7e -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:44 devstack sudo[104150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec9361db-be42-4708-b5c5-2951e228dd7e -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757
Jun 18 11:37:44 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:44 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-abcc72da-569c-4d87-be7c-5bd1c2b3df6a-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:44 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-abcc72da-569c-4d87-be7c-5bd1c2b3df6a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:44 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-quobyte-abcc72da-569c-4d87-be7c-5bd1c2b3df6a" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:44 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec9361db-be42-4708-b5c5-2951e228dd7e -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757" returned: 0 in 0.731s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:44 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757 is being set with open permissions: ugo+rw
Jun 18 11:37:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:44 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-abcc72da-569c-4d87-be7c-5bd1c2b3df6a" acquired by "delete_volume" :: waited 0.043s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:44 devstack sudo[104155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757
Jun 18 11:37:44 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:44 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ed0e7f-9ad6-4515-acf0-4b14def2e6bc]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:44 devstack sudo[104157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a
Jun 18 11:37:44 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:45 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:37:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Flow 'volume_create_manager' (7a0d4a80-aaec-4f5a-9849-96d5925d5df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6983a889-fa94-4434-87f4-7224f0fa450a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6983a889-fa94-4434-87f4-7224f0fa450a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1796783744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bae1525-f119-46db-a744-f60ad9edd564,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cef7602cc6647e881e5ac6e4ab97582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:45Z,use_quota=True,user_id='36576f8c50dd49ce9a2129dfda39e7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0a07da-4515-4165-a02e-6cdc15678fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0a07da-4515-4165-a02e-6cdc15678fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0813eab-849e-4d77-a202-9e8353757dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0813eab-849e-4d77-a202-9e8353757dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bae1525-f119-46db-a744-f60ad9edd564', 'volume_name': 'volume-2bae1525-f119-46db-a744-f60ad9edd564', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1331d79d-05ba-4f1d-9b0c-13e2776ed449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1331d79d-05ba-4f1d-9b0c-13e2776ed449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc9d2df-4a72-4369-ae08-8c2842932776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:45 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Volume 2bae1525-f119-46db-a744-f60ad9edd564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bae1525-f119-46db-a744-f60ad9edd564', 'volume_size': 1}
Jun 18 11:37:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:45 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757" returned: 0 in 0.721s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:45 devstack sudo[104163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.info
Jun 18 11:37:45 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:45 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a" returned: 0 in 0.814s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:45 devstack sudo[104166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a
Jun 18 11:37:45 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:46 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.info" returned: 0 in 0.683s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:46 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.info is being set with open permissions: ugo+rw
Jun 18 11:37:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:46 devstack sudo[104170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.info
Jun 18 11:37:46 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:46 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-abcc72da-569c-4d87-be7c-5bd1c2b3df6a" returned: 0 in 0.670s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:46 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-abcc72da-569c-4d87-be7c-5bd1c2b3df6a" released by "delete_volume" :: held 1.558s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:46 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] Created reservations ['3a1426a1-01ae-49cd-b6db-c124f182e5b7', 'c884c182-ae83-462d-af03-fcc37ec9e7e6', '3a1e76de-3602-414a-a06e-637ddff49d31', '847b7a50-4abe-49b0-a885-66c0a8bb236c'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:37:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:46 devstack sudo[104172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:37:46 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:46 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.info" returned: 0 in 0.704s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:46 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Acquiring lock "cinder-quobyte-084676b1-d20e-4052-a9fe-3e73756c6fea" by "_copy_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:46 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Lock "cinder-quobyte-084676b1-d20e-4052-a9fe-3e73756c6fea" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] snapshot: ff4c5460-b3d8-4a49-aad9-1bca6a568757, volume: 084676b1-d20e-4052-a9fe-3e73756c6fea,  {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d238d4-183f-44bf-86fc-f3dc26792e5e]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-9bdaff2f-01ba-4455-8392-4f9df818bad4-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-9bdaff2f-01ba-4455-8392-4f9df818bad4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "cinder-quobyte-9bdaff2f-01ba-4455-8392-4f9df818bad4" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-9bdaff2f-01ba-4455-8392-4f9df818bad4" acquired by "delete_volume" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:47 devstack sudo[104175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757
Jun 18 11:37:47 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[3505181f-0918-4382-95c9-1641a0962b20]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:47 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.704s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:37:47 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] Deleted volume successfully.
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f080f0d8-ca87-4064-869e-189ae5add630 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-abcc72da-569c-4d87-be7c-5bd1c2b3df6a-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:47 devstack sudo[104178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4
Jun 18 11:37:47 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:47 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757" returned: 0 in 0.809s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec9361db-be42-4708-b5c5-2951e228dd7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Creating direct copy from snapshot {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5182257-389d-4c83-aadb-1f55cd330b16]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:47 devstack sudo[104186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e
Jun 18 11:37:47 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:47 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4" returned: 0 in 0.766s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:47 devstack sudo[104188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4
Jun 18 11:37:47 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:48 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e" returned: 0 in 0.763s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:48 devstack cinder-volume[91663]: DEBUG cinder.utils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Path /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-084676b1-d20e-4052-a9fe-3e73756c6fea not found in is_blk_device check {{(pid=91663) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 18 11:37:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-084676b1-d20e-4052-a9fe-3e73756c6fea {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:48 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9bdaff2f-01ba-4455-8392-4f9df818bad4" returned: 0 in 0.667s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:48 devstack sudo[104194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-084676b1-d20e-4052-a9fe-3e73756c6fea
Jun 18 11:37:48 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:48 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-quobyte-9bdaff2f-01ba-4455-8392-4f9df818bad4" released by "delete_volume" :: held 1.504s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:48 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] Created reservations ['6f7b93ce-e557-471a-a8bd-58d572e1101f', '71b7ff97-bb4a-4263-a66e-5e285219dcc8', 'ad476f83-3b6c-4c7f-9aae-fa9337157cd1', '42d34e0b-d081-4da9-96bb-e39a625172de'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:37:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:48 devstack sudo[104196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:37:48 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:49 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.669s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:49 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:37:49 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] Deleted volume successfully.
Jun 18 11:37:49 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96c1aa1a-64f9-4631-abc0-dd34dd33a730 tempest-VolumesSnapshotTestJSON-1640399948 None] Lock "cinder-9bdaff2f-01ba-4455-8392-4f9df818bad4-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-084676b1-d20e-4052-a9fe-3e73756c6fea" returned: 0 in 5.309s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:53 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e905db-b0be-4429-a70e-5c726949bb64]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:54 devstack sudo[104212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e
Jun 18 11:37:54 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:54 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e" returned: 0 in 1.015s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:54 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e, size 1024.00 MB, duration 5.31 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-084676b1-d20e-4052-a9fe-3e73756c6fea {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:37:54 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Converted 1024.00 MB image at 192.83 MB/s
Jun 18 11:37:54 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-084676b1-d20e-4052-a9fe-3e73756c6fea is being set with open permissions: ugo+rw
Jun 18 11:37:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-084676b1-d20e-4052-a9fe-3e73756c6fea {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:54 devstack sudo[104217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-084676b1-d20e-4052-a9fe-3e73756c6fea
Jun 18 11:37:54 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:55 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-084676b1-d20e-4052-a9fe-3e73756c6fea" returned: 0 in 0.718s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Lock "cinder-quobyte-084676b1-d20e-4052-a9fe-3e73756c6fea" released by "_copy_volume_from_snapshot" :: held 8.704s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Acquiring lock "cinder-quobyte-ff4c5460-b3d8-4a49-aad9-1bca6a568757" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Lock "cinder-quobyte-ff4c5460-b3d8-4a49-aad9-1bca6a568757" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:55 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Deleting offline snapshot ff4c5460-b3d8-4a49-aad9-1bca6a568757 of volume ec9361db-be42-4708-b5c5-2951e228dd7e {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:37:55 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] snapshot_file for this snap is: volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:37:55 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6d7fc9-a6df-4748-84a9-9a5100e8b15a]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:55 devstack sudo[104221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757
Jun 18 11:37:55 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:56 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757" returned: 0 in 0.813s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec9361db-be42-4708-b5c5-2951e228dd7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:37:56 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c9695b-357c-450d-8db8-3a19ffc73726]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:56 devstack sudo[104226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e
Jun 18 11:37:56 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:57 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e" returned: 0 in 0.762s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:57 devstack sudo[104231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757
Jun 18 11:37:57 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:57 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:37:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Flow 'volume_create_manager' (9f5ac023-d84e-415e-824e-14fdae90355b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b5c56a-7c52-4fcc-b831-f1d8b366a603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b5c56a-7c52-4fcc-b831-f1d8b366a603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-269163022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bb6e50-ebd9-4e6f-aa4d-d91d639f24af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8bd2dbe9f4dcb91232ea8330c0f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:58Z,use_quota=True,user_id='8223db6883484e9483ce34f55bd79995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3930f9c-a76e-4eba-bcbc-e4451f245945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3930f9c-a76e-4eba-bcbc-e4451f245945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f787bca4-0609-49d3-8fa2-fa9cfef423bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f787bca4-0609-49d3-8fa2-fa9cfef423bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35bb6e50-ebd9-4e6f-aa4d-d91d639f24af', 'volume_name': 'volume-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21491174-602f-4644-889d-2e8afb07289e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21491174-602f-4644-889d-2e8afb07289e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497133b7-aa5c-4272-8ccd-bbc92992fa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:57 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume 35bb6e50-ebd9-4e6f-aa4d-d91d639f24af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af', 'volume_size': 1}
Jun 18 11:37:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:58 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757" returned: 0 in 0.746s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:58 devstack sudo[104236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757
Jun 18 11:37:58 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:58 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e.ff4c5460-b3d8-4a49-aad9-1bca6a568757" returned: 0 in 0.643s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Lock "cinder-quobyte-ff4c5460-b3d8-4a49-aad9-1bca6a568757" released by "_delete_snapshot" :: held 3.050s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.651s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.411s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1796783744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bae1525-f119-46db-a744-f60ad9edd564,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cef7602cc6647e881e5ac6e4ab97582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:45Z,use_quota=True,user_id='36576f8c50dd49ce9a2129dfda39e7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Creating volume 2bae1525-f119-46db-a744-f60ad9edd564 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:37:58 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2bae1525-f119-46db-a744-f60ad9edd564 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ceeedb-8371-48e2-ab6e-37b6e0bfb45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-084676b1-d20e-4052-a9fe-3e73756c6fea', 'volume_size': 2, 'source_volid': 'ec9361db-be42-4708-b5c5-2951e228dd7e', 'source_volstatus': 'available'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:58 devstack sudo[104239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2bae1525-f119-46db-a744-f60ad9edd564 1073741824
Jun 18 11:37:58 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07bb0cf-c7ac-4ab3-9438-6b2bd4a08328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:37:58 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Volume volume-084676b1-d20e-4052-a9fe-3e73756c6fea (084676b1-d20e-4052-a9fe-3e73756c6fea): created successfully
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07bb0cf-c7ac-4ab3-9438-6b2bd4a08328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:37:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Flow 'volume_create_manager' (2b433df4-a2c8-4be4-a025-0349a8031fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:37:58 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-06d50c40-b161-4fa7-913f-784623aecb49 tempest-VolumesCloneTest-435830861 None] Created volume successfully.
Jun 18 11:37:59 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root
Jun 18 11:37:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2bae1525-f119-46db-a744-f60ad9edd564 1073741824" returned: 0 in 0.803s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:37:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2bae1525-f119-46db-a744-f60ad9edd564 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:59 devstack sudo[104246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2bae1525-f119-46db-a744-f60ad9edd564
Jun 18 11:37:59 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:37:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] Acquiring lock "cinder-084676b1-d20e-4052-a9fe-3e73756c6fea-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] Lock "cinder-084676b1-d20e-4052-a9fe-3e73756c6fea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] Acquiring lock "cinder-quobyte-084676b1-d20e-4052-a9fe-3e73756c6fea" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:37:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] Lock "cinder-quobyte-084676b1-d20e-4052-a9fe-3e73756c6fea" acquired by "delete_volume" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:37:59 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3eff6ac-dcf2-490a-96ea-d29431198843]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:37:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-084676b1-d20e-4052-a9fe-3e73756c6fea {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:37:59 devstack sudo[104248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-084676b1-d20e-4052-a9fe-3e73756c6fea
Jun 18 11:37:59 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:00 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2bae1525-f119-46db-a744-f60ad9edd564" returned: 0 in 0.666s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.582s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-269163022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bb6e50-ebd9-4e6f-aa4d-d91d639f24af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8bd2dbe9f4dcb91232ea8330c0f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:37:58Z,use_quota=True,user_id='8223db6883484e9483ce34f55bd79995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Creating volume 35bb6e50-ebd9-4e6f-aa4d-d91d639f24af {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:38:00 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc9d2df-4a72-4369-ae08-8c2842932776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bae1525-f119-46db-a744-f60ad9edd564', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:00 devstack sudo[104252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af 1073741824
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da569ec-b88f-4fe2-a75d-744b4e1902cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:00 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:00 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Volume volume-2bae1525-f119-46db-a744-f60ad9edd564 (2bae1525-f119-46db-a744-f60ad9edd564): created successfully
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da569ec-b88f-4fe2-a75d-744b4e1902cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Flow 'volume_create_manager' (7a0d4a80-aaec-4f5a-9849-96d5925d5df9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:00 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-025d6600-d2d4-4411-91b1-6bab910c1e10 tempest-VolumesListTestJSON-1856963534 None] Created volume successfully.
Jun 18 11:38:00 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-084676b1-d20e-4052-a9fe-3e73756c6fea" returned: 0 in 0.780s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-084676b1-d20e-4052-a9fe-3e73756c6fea {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:00 devstack sudo[104257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-084676b1-d20e-4052-a9fe-3e73756c6fea
Jun 18 11:38:00 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Flow 'volume_create_manager' (5f6a02e0-aa39-4309-8670-e77a66dce3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9366cc3-d95f-44b0-b1a4-5f8f2a2d50d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9366cc3-d95f-44b0-b1a4-5f8f2a2d50d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2058414671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2924baff-51a0-44f0-9bf2-9dc0591c1469,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cef7602cc6647e881e5ac6e4ab97582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:01Z,use_quota=True,user_id='36576f8c50dd49ce9a2129dfda39e7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c6465b-522e-49d0-9832-cfe28091cae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:01 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c6465b-522e-49d0-9832-cfe28091cae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d6f146-6991-4528-922b-26e7b760632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d6f146-6991-4528-922b-26e7b760632e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2924baff-51a0-44f0-9bf2-9dc0591c1469', 'volume_name': 'volume-2924baff-51a0-44f0-9bf2-9dc0591c1469', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:01 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d419182-c733-4d47-8e6b-0ed485feaee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d419182-c733-4d47-8e6b-0ed485feaee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d406f3-4f3a-4a7c-b9f9-1750acbc0952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:01 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Volume 2924baff-51a0-44f0-9bf2-9dc0591c1469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2924baff-51a0-44f0-9bf2-9dc0591c1469', 'volume_size': 1}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-084676b1-d20e-4052-a9fe-3e73756c6fea" returned: 0 in 0.710s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af 1073741824" returned: 0 in 0.984s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] Lock "cinder-quobyte-084676b1-d20e-4052-a9fe-3e73756c6fea" released by "delete_volume" :: held 1.543s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:01 devstack sudo[104265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af
Jun 18 11:38:01 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] Created reservations ['79bf2fbc-2ac4-4f8f-a98e-b5225c8d7ed6', '33a7c3aa-1b06-41ec-b902-76fc669edcef', 'f19be59e-4f79-43a2-aa56-66bcd610a99a', '91930872-268d-47d9-ac27-09c4dcdca217'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:01 devstack sudo[104267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:38:01 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] Acquiring lock "cinder-ec9361db-be42-4708-b5c5-2951e228dd7e-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:02 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af" returned: 0 in 0.685s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.748s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2058414671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2924baff-51a0-44f0-9bf2-9dc0591c1469,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cef7602cc6647e881e5ac6e4ab97582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:01Z,use_quota=True,user_id='36576f8c50dd49ce9a2129dfda39e7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Creating volume 2924baff-51a0-44f0-9bf2-9dc0591c1469 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:38:02 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2924baff-51a0-44f0-9bf2-9dc0591c1469 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:02 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] Lock "cinder-ec9361db-be42-4708-b5c5-2951e228dd7e-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:02 devstack sudo[104271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2924baff-51a0-44f0-9bf2-9dc0591c1469 1073741824
Jun 18 11:38:02 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497133b7-aa5c-4272-8ccd-bbc92992fa13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4febcb47-fa20-4167-8b4d-fa9a2addddf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.673s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:38:02 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] Deleted volume successfully.
Jun 18 11:38:02 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume volume-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af (35bb6e50-ebd9-4e6f-aa4d-d91d639f24af): created successfully
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4febcb47-fa20-4167-8b4d-fa9a2addddf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Flow 'volume_create_manager' (9f5ac023-d84e-415e-824e-14fdae90355b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:02 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-df873f4a-ef6f-4c47-b705-56685d2e6bd6 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Created volume successfully.
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] Acquiring lock "cinder-quobyte-ec9361db-be42-4708-b5c5-2951e228dd7e" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e2b2b094-ee2d-4b29-98c1-1a5abddba910 tempest-VolumesCloneTest-435830861 None] Lock "cinder-084676b1-d20e-4052-a9fe-3e73756c6fea-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] Lock "cinder-quobyte-ec9361db-be42-4708-b5c5-2951e228dd7e" acquired by "delete_volume" :: waited 0.030s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4d1185-3de7-46d6-8633-a5928faeee6b]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:02 devstack sudo[104274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e
Jun 18 11:38:02 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:02 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2924baff-51a0-44f0-9bf2-9dc0591c1469 1073741824" returned: 0 in 0.855s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2924baff-51a0-44f0-9bf2-9dc0591c1469 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:03 devstack sudo[104283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2924baff-51a0-44f0-9bf2-9dc0591c1469
Jun 18 11:38:03 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:03 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e" returned: 0 in 0.798s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:03 devstack sudo[104287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e
Jun 18 11:38:03 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Flow 'volume_create_manager' (fceed2e0-77aa-4237-b5f1-d300dca6e4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196ebb0c-1e5c-45fa-a2f3-1c82831e8c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196ebb0c-1e5c-45fa-a2f3-1c82831e8c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1655107363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128031b3-bda5-46af-bb62-a77fd9267eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8bd2dbe9f4dcb91232ea8330c0f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:03Z,use_quota=True,user_id='8223db6883484e9483ce34f55bd79995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a1ffcb-f0b6-460d-8c09-dbbc9c1ebb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a1ffcb-f0b6-460d-8c09-dbbc9c1ebb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4ace29-974b-4cc8-b45d-3b9a185ce145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4ace29-974b-4cc8-b45d-3b9a185ce145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '128031b3-bda5-46af-bb62-a77fd9267eb6', 'volume_name': 'volume-128031b3-bda5-46af-bb62-a77fd9267eb6', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385c702f-2b99-40c5-a8a5-94b3a3964f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385c702f-2b99-40c5-a8a5-94b3a3964f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efd8229-d5c8-44b8-925a-233fb51985a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:03 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume 128031b3-bda5-46af-bb62-a77fd9267eb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-128031b3-bda5-46af-bb62-a77fd9267eb6', 'volume_size': 1}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:03 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2924baff-51a0-44f0-9bf2-9dc0591c1469" returned: 0 in 0.782s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.125s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1655107363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128031b3-bda5-46af-bb62-a77fd9267eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8bd2dbe9f4dcb91232ea8330c0f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:03Z,use_quota=True,user_id='8223db6883484e9483ce34f55bd79995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Creating volume 128031b3-bda5-46af-bb62-a77fd9267eb6 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:38:03 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-128031b3-bda5-46af-bb62-a77fd9267eb6 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:03 devstack sudo[104290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-128031b3-bda5-46af-bb62-a77fd9267eb6 1073741824
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d406f3-4f3a-4a7c-b9f9-1750acbc0952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2924baff-51a0-44f0-9bf2-9dc0591c1469', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:03 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7dfcb9-a1ef-4c56-8a67-2d68944618d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:03 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Volume volume-2924baff-51a0-44f0-9bf2-9dc0591c1469 (2924baff-51a0-44f0-9bf2-9dc0591c1469): created successfully
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7dfcb9-a1ef-4c56-8a67-2d68944618d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Flow 'volume_create_manager' (5f6a02e0-aa39-4309-8670-e77a66dce3a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Flow 'volume_create_manager' (8275a269-505a-4023-b1ab-8992e767939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f12eff6-ee22-4f87-bc18-bcd13b4a93e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:03 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-aa70f42c-502f-411f-b78d-f2070b0a0e87 tempest-VolumesListTestJSON-1856963534 None] Created volume successfully.
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f12eff6-ee22-4f87-bc18-bcd13b4a93e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-114990028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499093c5-97c4-460b-82a7-11163565a374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8bd2dbe9f4dcb91232ea8330c0f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:04Z,use_quota=True,user_id='8223db6883484e9483ce34f55bd79995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8ea4d4-9ae8-4687-a66d-3585bf6e3acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8ea4d4-9ae8-4687-a66d-3585bf6e3acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216563f9-8966-47c2-976b-9f92a8d13e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216563f9-8966-47c2-976b-9f92a8d13e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '499093c5-97c4-460b-82a7-11163565a374', 'volume_name': 'volume-499093c5-97c4-460b-82a7-11163565a374', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bc477c-f048-40d2-9d5b-2bf8893f6670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bc477c-f048-40d2-9d5b-2bf8893f6670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3481994-1260-496c-968e-e21d436bfb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:03 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume 499093c5-97c4-460b-82a7-11163565a374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-499093c5-97c4-460b-82a7-11163565a374', 'volume_size': 1}
Jun 18 11:38:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:04 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ec9361db-be42-4708-b5c5-2951e228dd7e" returned: 0 in 0.923s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] Lock "cinder-quobyte-ec9361db-be42-4708-b5c5-2951e228dd7e" released by "delete_volume" :: held 1.778s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] Created reservations ['ff0fbd92-e491-4c3c-b2c6-a68a14c45a46', 'ba299d66-8d9d-4bd1-b8d5-587ebf818bc9', '030cfd5f-316b-4985-ad1a-87f652c021bd', '1c426bdb-d2a7-4aca-ae97-9ad096ea389f'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Flow 'volume_create_manager' (540a90ae-280a-4da5-9193-b30f57a478a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186a7f2a-6726-4a03-b60b-88e2c748519e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186a7f2a-6726-4a03-b60b-88e2c748519e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1514318341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8bd2dbe9f4dcb91232ea8330c0f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:04Z,use_quota=True,user_id='8223db6883484e9483ce34f55bd79995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e3a5c6-ce09-46dc-bece-be7e1ab57676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e3a5c6-ce09-46dc-bece-be7e1ab57676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:04 devstack sudo[104293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:38:04 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1255dbf8-60f4-4255-9e0c-7085eedaa878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1255dbf8-60f4-4255-9e0c-7085eedaa878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd', 'volume_name': 'volume-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae6a3b6-dd04-4338-94b7-7ef87138180b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae6a3b6-dd04-4338-94b7-7ef87138180b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55aa9c36-de5b-4ab0-81c3-03915050d046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:04 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume 6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd', 'volume_size': 1}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:04 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Flow 'volume_create_manager' (f2431327-4618-4311-8842-473a40fa1a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23b1128-e475-47e4-bf32-6173c5a6fa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23b1128-e475-47e4-bf32-6173c5a6fa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-515956508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31cd87e-cd6c-4024-baa4-f150190cad06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8bd2dbe9f4dcb91232ea8330c0f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:05Z,use_quota=True,user_id='8223db6883484e9483ce34f55bd79995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b773e7-eec3-4662-a335-7b3f3c495ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b773e7-eec3-4662-a335-7b3f3c495ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5723d4-5386-4cb8-a05f-0e71bb52a8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5723d4-5386-4cb8-a05f-0e71bb52a8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f31cd87e-cd6c-4024-baa4-f150190cad06', 'volume_name': 'volume-f31cd87e-cd6c-4024-baa4-f150190cad06', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dcb0e6-bad0-4a0b-b76c-e7bfadfc147f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dcb0e6-bad0-4a0b-b76c-e7bfadfc147f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b1026d-5147-462a-9659-dd206d601420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:05 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume f31cd87e-cd6c-4024-baa4-f150190cad06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f31cd87e-cd6c-4024-baa4-f150190cad06', 'volume_size': 1}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:05 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-128031b3-bda5-46af-bb62-a77fd9267eb6 1073741824" returned: 0 in 1.432s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:05 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.960s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:38:05 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] Deleted volume successfully.
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-128031b3-bda5-46af-bb62-a77fd9267eb6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-624422ce-75fb-4146-b287-58f88cd2a813 tempest-VolumesCloneTest-435830861 None] Lock "cinder-ec9361db-be42-4708-b5c5-2951e228dd7e-delete_volume" released by "delete_volume" :: held 3.150s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:05 devstack sudo[104302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-128031b3-bda5-46af-bb62-a77fd9267eb6
Jun 18 11:38:05 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Flow 'volume_create_manager' (7ca00ed7-5d0c-4df4-a92c-13c8dbc7d3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c089ed1b-1ef6-488e-be68-1928173ef72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Flow 'volume_create_manager' (6bbbc983-b363-4c51-bdf3-aa162c6d6a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86834f82-d971-4b42-82c7-15612b0fc8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c089ed1b-1ef6-488e-be68-1928173ef72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2042585728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f67d601-7065-4cbd-9904-d86358dc3f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8bd2dbe9f4dcb91232ea8330c0f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:06Z,use_quota=True,user_id='8223db6883484e9483ce34f55bd79995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25931fc-5b7e-462d-9528-eabc5ab25106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25931fc-5b7e-462d-9528-eabc5ab25106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd14c8b-0f1e-4ce9-ad52-e7117a55ba69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd14c8b-0f1e-4ce9-ad52-e7117a55ba69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f67d601-7065-4cbd-9904-d86358dc3f07', 'volume_name': 'volume-3f67d601-7065-4cbd-9904-d86358dc3f07', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3605af-53ef-4f38-9db5-4d7e03983404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3605af-53ef-4f38-9db5-4d7e03983404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e76d6a0-bba0-43f9-9570-8c268ce40ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:05 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume 3f67d601-7065-4cbd-9904-d86358dc3f07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f67d601-7065-4cbd-9904-d86358dc3f07', 'volume_size': 1}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86834f82-d971-4b42-82c7-15612b0fc8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1101983594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=369380a9-8938-49a1-a24a-53f554c74b5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cef7602cc6647e881e5ac6e4ab97582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:06Z,use_quota=True,user_id='36576f8c50dd49ce9a2129dfda39e7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea6b0b6-330b-4ace-9c66-7b03dcebe815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea6b0b6-330b-4ace-9c66-7b03dcebe815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c01261-2367-464c-ab7c-7005a2bb4dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c01261-2367-464c-ab7c-7005a2bb4dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '369380a9-8938-49a1-a24a-53f554c74b5c', 'volume_name': 'volume-369380a9-8938-49a1-a24a-53f554c74b5c', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e6d7fc-b938-4223-8c02-5d66052e5e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e6d7fc-b938-4223-8c02-5d66052e5e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d1b3b0-a258-4be4-8920-34939954ff3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:05 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Volume 369380a9-8938-49a1-a24a-53f554c74b5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-369380a9-8938-49a1-a24a-53f554c74b5c', 'volume_size': 1}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:05 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-128031b3-bda5-46af-bb62-a77fd9267eb6" returned: 0 in 0.691s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] <== create_volume: return (2187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.189s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.993s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-114990028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499093c5-97c4-460b-82a7-11163565a374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8bd2dbe9f4dcb91232ea8330c0f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:04Z,use_quota=True,user_id='8223db6883484e9483ce34f55bd79995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Creating volume 499093c5-97c4-460b-82a7-11163565a374 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:38:05 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:38:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-499093c5-97c4-460b-82a7-11163565a374 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efd8229-d5c8-44b8-925a-233fb51985a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-128031b3-bda5-46af-bb62-a77fd9267eb6', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:06 devstack sudo[104313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-499093c5-97c4-460b-82a7-11163565a374 1073741824
Jun 18 11:38:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5174b4-ed17-44e3-9ab1-6f23b4ab5f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:06 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:06 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume volume-128031b3-bda5-46af-bb62-a77fd9267eb6 (128031b3-bda5-46af-bb62-a77fd9267eb6): created successfully
Jun 18 11:38:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5174b4-ed17-44e3-9ab1-6f23b4ab5f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Flow 'volume_create_manager' (fceed2e0-77aa-4237-b5f1-d300dca6e4d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:06 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-3b3d87c1-5690-4f2f-9b58-84a2523c8bc0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Created volume successfully.
Jun 18 11:38:06 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-499093c5-97c4-460b-82a7-11163565a374 1073741824" returned: 0 in 0.888s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-499093c5-97c4-460b-82a7-11163565a374 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:06 devstack sudo[104319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-499093c5-97c4-460b-82a7-11163565a374
Jun 18 11:38:06 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:07 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-499093c5-97c4-460b-82a7-11163565a374" returned: 0 in 0.701s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.205s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1514318341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8bd2dbe9f4dcb91232ea8330c0f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:04Z,use_quota=True,user_id='8223db6883484e9483ce34f55bd79995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Creating volume 6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:38:07 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:07 devstack sudo[104322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd 1073741824
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3481994-1260-496c-968e-e21d436bfb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-499093c5-97c4-460b-82a7-11163565a374', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:07 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e262fbc0-c884-42ff-9928-be61b29f068f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:07 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume volume-499093c5-97c4-460b-82a7-11163565a374 (499093c5-97c4-460b-82a7-11163565a374): created successfully
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e262fbc0-c884-42ff-9928-be61b29f068f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Flow 'volume_create_manager' (8275a269-505a-4023-b1ab-8992e767939f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:07 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-5571cdb6-6f79-4f46-ac3d-ee5061b6592f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Created volume successfully.
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Flow 'volume_create_manager' (9cb4efce-e777-4883-bd0d-577daa45b08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5dc2c1-2865-4469-90fe-66abc526e77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5dc2c1-2865-4469-90fe-66abc526e77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2138314940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f642cadb-b49c-4498-8fba-d0eb809a74cc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='80229cfc6efc4b7ab553b1225b3eeb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:08Z,use_quota=True,user_id='88790e9e355946e0b807c986a668f96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a089ee2-3cef-4729-98b8-f4d32b9602f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a089ee2-3cef-4729-98b8-f4d32b9602f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f10a727-1b93-4e9e-bb1c-4a2e065e4853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f10a727-1b93-4e9e-bb1c-4a2e065e4853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f642cadb-b49c-4498-8fba-d0eb809a74cc', 'volume_name': 'volume-f642cadb-b49c-4498-8fba-d0eb809a74cc', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043bdf82-6a01-4df6-90e5-c0d1097b1214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043bdf82-6a01-4df6-90e5-c0d1097b1214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db2dd1d-58df-48e0-a3d8-463d394b5dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:07 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Volume f642cadb-b49c-4498-8fba-d0eb809a74cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f642cadb-b49c-4498-8fba-d0eb809a74cc', 'volume_size': 1}
Jun 18 11:38:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:08 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd 1073741824" returned: 0 in 0.830s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:08 devstack sudo[104328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd
Jun 18 11:38:08 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:09 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd" returned: 0 in 0.642s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.977s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-515956508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31cd87e-cd6c-4024-baa4-f150190cad06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8bd2dbe9f4dcb91232ea8330c0f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:05Z,use_quota=True,user_id='8223db6883484e9483ce34f55bd79995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Creating volume f31cd87e-cd6c-4024-baa4-f150190cad06 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:38:09 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f31cd87e-cd6c-4024-baa4-f150190cad06 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:09 devstack sudo[104331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f31cd87e-cd6c-4024-baa4-f150190cad06 1073741824
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55aa9c36-de5b-4ab0-81c3-03915050d046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:09 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f21923-aa79-456c-ab90-83a1f2c7b6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:09 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume volume-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd (6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd): created successfully
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f21923-aa79-456c-ab90-83a1f2c7b6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Flow 'volume_create_manager' (540a90ae-280a-4da5-9193-b30f57a478a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:09 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d1a8be5e-2ce9-42bd-a7c1-c5cd58c5b73d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Created volume successfully.
Jun 18 11:38:09 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f31cd87e-cd6c-4024-baa4-f150190cad06 1073741824" returned: 0 in 0.815s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f31cd87e-cd6c-4024-baa4-f150190cad06 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:10 devstack sudo[104338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f31cd87e-cd6c-4024-baa4-f150190cad06
Jun 18 11:38:10 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:10 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f31cd87e-cd6c-4024-baa4-f150190cad06" returned: 0 in 0.653s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:38:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.819s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2042585728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f67d601-7065-4cbd-9904-d86358dc3f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8bd2dbe9f4dcb91232ea8330c0f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:06Z,use_quota=True,user_id='8223db6883484e9483ce34f55bd79995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:38:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Creating volume 3f67d601-7065-4cbd-9904-d86358dc3f07 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:38:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:38:10 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:38:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3f67d601-7065-4cbd-9904-d86358dc3f07 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:10 devstack sudo[104341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3f67d601-7065-4cbd-9904-d86358dc3f07 1073741824
Jun 18 11:38:10 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b1026d-5147-462a-9659-dd206d601420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f31cd87e-cd6c-4024-baa4-f150190cad06', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ccca4e-bc50-40fb-a0af-97a2c2faab64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:10 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume volume-f31cd87e-cd6c-4024-baa4-f150190cad06 (f31cd87e-cd6c-4024-baa4-f150190cad06): created successfully
Jun 18 11:38:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ccca4e-bc50-40fb-a0af-97a2c2faab64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Flow 'volume_create_manager' (f2431327-4618-4311-8842-473a40fa1a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:10 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-20c16371-f01c-45e6-bf7e-5465f3e7ce26 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Created volume successfully.
Jun 18 11:38:11 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3f67d601-7065-4cbd-9904-d86358dc3f07 1073741824" returned: 0 in 0.810s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3f67d601-7065-4cbd-9904-d86358dc3f07 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:11 devstack sudo[104347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3f67d601-7065-4cbd-9904-d86358dc3f07
Jun 18 11:38:11 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:12 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3f67d601-7065-4cbd-9904-d86358dc3f07" returned: 0 in 0.626s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.260s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1101983594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=369380a9-8938-49a1-a24a-53f554c74b5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cef7602cc6647e881e5ac6e4ab97582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:06Z,use_quota=True,user_id='36576f8c50dd49ce9a2129dfda39e7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Creating volume 369380a9-8938-49a1-a24a-53f554c74b5c {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:38:12 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-369380a9-8938-49a1-a24a-53f554c74b5c 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:12 devstack sudo[104350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-369380a9-8938-49a1-a24a-53f554c74b5c 1073741824
Jun 18 11:38:12 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e76d6a0-bba0-43f9-9570-8c268ce40ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f67d601-7065-4cbd-9904-d86358dc3f07', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d89e517-4d7c-46ad-944f-06ab168ba1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:12 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Volume volume-3f67d601-7065-4cbd-9904-d86358dc3f07 (3f67d601-7065-4cbd-9904-d86358dc3f07): created successfully
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d89e517-4d7c-46ad-944f-06ab168ba1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Flow 'volume_create_manager' (7ca00ed7-5d0c-4df4-a92c-13c8dbc7d3df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:12 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-9bcc86db-e12e-490c-9693-6a6aeffd78c9 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Created volume successfully.
Jun 18 11:38:12 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-369380a9-8938-49a1-a24a-53f554c74b5c 1073741824" returned: 0 in 0.800s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-369380a9-8938-49a1-a24a-53f554c74b5c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:12 devstack sudo[104356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-369380a9-8938-49a1-a24a-53f554c74b5c
Jun 18 11:38:12 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "cinder-3f67d601-7065-4cbd-9904-d86358dc3f07-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-3f67d601-7065-4cbd-9904-d86358dc3f07-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "cinder-quobyte-3f67d601-7065-4cbd-9904-d86358dc3f07" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-quobyte-3f67d601-7065-4cbd-9904-d86358dc3f07" acquired by "delete_volume" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[f521b0a4-5b2d-440a-9456-c147d779ba35]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3f67d601-7065-4cbd-9904-d86358dc3f07 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:13 devstack sudo[104358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3f67d601-7065-4cbd-9904-d86358dc3f07
Jun 18 11:38:13 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:13 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-369380a9-8938-49a1-a24a-53f554c74b5c" returned: 0 in 0.686s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.839s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2138314940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f642cadb-b49c-4498-8fba-d0eb809a74cc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='80229cfc6efc4b7ab553b1225b3eeb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:08Z,use_quota=True,user_id='88790e9e355946e0b807c986a668f96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Creating volume f642cadb-b49c-4498-8fba-d0eb809a74cc {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:38:13 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f642cadb-b49c-4498-8fba-d0eb809a74cc 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:13 devstack sudo[104361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f642cadb-b49c-4498-8fba-d0eb809a74cc 1073741824
Jun 18 11:38:13 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d1b3b0-a258-4be4-8920-34939954ff3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-369380a9-8938-49a1-a24a-53f554c74b5c', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b13846-9750-4206-8bfa-57457a4fa4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:13 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Volume volume-369380a9-8938-49a1-a24a-53f554c74b5c (369380a9-8938-49a1-a24a-53f554c74b5c): created successfully
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b13846-9750-4206-8bfa-57457a4fa4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Flow 'volume_create_manager' (6bbbc983-b363-4c51-bdf3-aa162c6d6a8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:13 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-82d85d44-7709-46f2-b8c6-4121470be80e tempest-VolumesListTestJSON-1856963534 None] Created volume successfully.
Jun 18 11:38:13 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3f67d601-7065-4cbd-9904-d86358dc3f07" returned: 0 in 0.763s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3f67d601-7065-4cbd-9904-d86358dc3f07 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:13 devstack sudo[104366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3f67d601-7065-4cbd-9904-d86358dc3f07
Jun 18 11:38:13 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:14 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f642cadb-b49c-4498-8fba-d0eb809a74cc 1073741824" returned: 0 in 0.830s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f642cadb-b49c-4498-8fba-d0eb809a74cc {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:14 devstack sudo[104372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f642cadb-b49c-4498-8fba-d0eb809a74cc
Jun 18 11:38:14 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:14 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3f67d601-7065-4cbd-9904-d86358dc3f07" returned: 0 in 0.670s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-quobyte-3f67d601-7065-4cbd-9904-d86358dc3f07" released by "delete_volume" :: held 1.480s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:14 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Created reservations ['53670d83-c44c-40c5-bff6-52d51d4d18b4', '1272f9dd-4004-457b-b80d-af6dab1048cf', 'bd4db02d-87af-4ce7-975f-5f2850915d30', '5392a8ab-dd41-4ea2-91d4-6a828d6bbb90'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:38:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:14 devstack sudo[104374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:38:14 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:15 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f642cadb-b49c-4498-8fba-d0eb809a74cc" returned: 0 in 0.669s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:38:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db2dd1d-58df-48e0-a3d8-463d394b5dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f642cadb-b49c-4498-8fba-d0eb809a74cc', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd99ef12-1ae2-464f-a76b-e04f2f2f1c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:15 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Volume volume-f642cadb-b49c-4498-8fba-d0eb809a74cc (f642cadb-b49c-4498-8fba-d0eb809a74cc): created successfully
Jun 18 11:38:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd99ef12-1ae2-464f-a76b-e04f2f2f1c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Flow 'volume_create_manager' (9cb4efce-e777-4883-bd0d-577daa45b08b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "cinder-f31cd87e-cd6c-4024-baa4-f150190cad06-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:15 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-641669bc-c751-43c8-8f46-a8fde80fbc68 tempest-VolumesGetTest-355417129 None] Created volume successfully.
Jun 18 11:38:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-f31cd87e-cd6c-4024-baa4-f150190cad06-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "cinder-quobyte-f31cd87e-cd6c-4024-baa4-f150190cad06" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-quobyte-f31cd87e-cd6c-4024-baa4-f150190cad06" acquired by "delete_volume" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:15 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[171f5865-12fa-48af-8498-d9290083a8c8]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f31cd87e-cd6c-4024-baa4-f150190cad06 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:15 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.727s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:15 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:38:15 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Deleted volume successfully.
Jun 18 11:38:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6e25a748-c8ab-4c32-acad-b7f9ae3adf35 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-3f67d601-7065-4cbd-9904-d86358dc3f07-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:15 devstack sudo[104378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f31cd87e-cd6c-4024-baa4-f150190cad06
Jun 18 11:38:15 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:16 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f31cd87e-cd6c-4024-baa4-f150190cad06" returned: 0 in 0.785s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f31cd87e-cd6c-4024-baa4-f150190cad06 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:16 devstack sudo[104383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f31cd87e-cd6c-4024-baa4-f150190cad06
Jun 18 11:38:16 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:16 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f31cd87e-cd6c-4024-baa4-f150190cad06" returned: 0 in 0.732s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-quobyte-f31cd87e-cd6c-4024-baa4-f150190cad06" released by "delete_volume" :: held 1.565s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:16 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Flow 'volume_create_manager' (2f84f426-5922-4910-a91b-f6cc3191832d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec3879c-a8a6-4021-9405-a1323736f146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] Acquiring lock "cinder-369380a9-8938-49a1-a24a-53f554c74b5c-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec3879c-a8a6-4021-9405-a1323736f146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-624318348',display_name='tempest-VolumesGetTest-Volume-1671725243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efe7b1e-cdb4-4dc2-8d69-06d28b836101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80229cfc6efc4b7ab553b1225b3eeb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:17Z,use_quota=True,user_id='88790e9e355946e0b807c986a668f96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a912d2-1a9e-4fe3-85ea-659e2287d397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a912d2-1a9e-4fe3-85ea-659e2287d397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b904c0-570c-4d85-b7d5-631233833a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b904c0-570c-4d85-b7d5-631233833a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8efe7b1e-cdb4-4dc2-8d69-06d28b836101', 'volume_name': 'volume-8efe7b1e-cdb4-4dc2-8d69-06d28b836101', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6162e599-1734-4c5e-8af9-e1e7824de77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6162e599-1734-4c5e-8af9-e1e7824de77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b424cc02-57e6-474c-a849-0999ed95418a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:17 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Volume 8efe7b1e-cdb4-4dc2-8d69-06d28b836101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8efe7b1e-cdb4-4dc2-8d69-06d28b836101', 'volume_size': 1}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-624318348',display_name='tempest-VolumesGetTest-Volume-1671725243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efe7b1e-cdb4-4dc2-8d69-06d28b836101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80229cfc6efc4b7ab553b1225b3eeb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:17Z,use_quota=True,user_id='88790e9e355946e0b807c986a668f96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Creating volume 8efe7b1e-cdb4-4dc2-8d69-06d28b836101 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:38:17 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8efe7b1e-cdb4-4dc2-8d69-06d28b836101 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:17 devstack sudo[104386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8efe7b1e-cdb4-4dc2-8d69-06d28b836101 1073741824
Jun 18 11:38:17 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] Lock "cinder-369380a9-8938-49a1-a24a-53f554c74b5c-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Created reservations ['999e9d8d-ad7d-4481-85f9-4f7fa00959f7', '2bb76358-0cba-4e34-8961-829f23a739bc', '63602c11-1f2d-4801-9a4e-8ae39510dc36', 'e0523507-e8f9-4ee8-8a99-c7bd43ab9b65'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] Acquiring lock "cinder-quobyte-369380a9-8938-49a1-a24a-53f554c74b5c" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] Lock "cinder-quobyte-369380a9-8938-49a1-a24a-53f554c74b5c" acquired by "delete_volume" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d2e36a-151d-47fa-8782-576550661bb6]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-369380a9-8938-49a1-a24a-53f554c74b5c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:17 devstack sudo[104388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:38:17 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:17 devstack sudo[104389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-369380a9-8938-49a1-a24a-53f554c74b5c
Jun 18 11:38:17 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "cinder-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "cinder-quobyte-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-quobyte-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd" acquired by "delete_volume" :: waited 0.025s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc753b3-0b79-4e9e-87bb-77aaf3ac3a7d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:17 devstack sudo[104392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd
Jun 18 11:38:17 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:17 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.763s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:17 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:38:17 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Deleted volume successfully.
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fb2cea93-99b5-41c0-b31f-b7218bc5aa24 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-f31cd87e-cd6c-4024-baa4-f150190cad06-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:18 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8efe7b1e-cdb4-4dc2-8d69-06d28b836101 1073741824" returned: 0 in 0.977s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8efe7b1e-cdb4-4dc2-8d69-06d28b836101 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:18 devstack sudo[104402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8efe7b1e-cdb4-4dc2-8d69-06d28b836101
Jun 18 11:38:18 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:18 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-369380a9-8938-49a1-a24a-53f554c74b5c" returned: 0 in 0.912s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-369380a9-8938-49a1-a24a-53f554c74b5c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:18 devstack sudo[104404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-369380a9-8938-49a1-a24a-53f554c74b5c
Jun 18 11:38:18 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:18 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd" returned: 0 in 0.841s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:18 devstack sudo[104409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd
Jun 18 11:38:18 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:18 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8efe7b1e-cdb4-4dc2-8d69-06d28b836101" returned: 0 in 0.706s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b424cc02-57e6-474c-a849-0999ed95418a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8efe7b1e-cdb4-4dc2-8d69-06d28b836101', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4fabd5f-7215-4802-b12d-88177d9cd41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:18 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-369380a9-8938-49a1-a24a-53f554c74b5c" returned: 0 in 0.696s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] Lock "cinder-quobyte-369380a9-8938-49a1-a24a-53f554c74b5c" released by "delete_volume" :: held 1.670s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:18 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Volume volume-8efe7b1e-cdb4-4dc2-8d69-06d28b836101 (8efe7b1e-cdb4-4dc2-8d69-06d28b836101): created successfully
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4fabd5f-7215-4802-b12d-88177d9cd41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Flow 'volume_create_manager' (2f84f426-5922-4910-a91b-f6cc3191832d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:18 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-05840df1-1bf5-466d-a817-86a2134e03bc tempest-VolumesGetTest-355417129 None] Created volume successfully.
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] Created reservations ['8485e738-ca0b-4c97-9533-2fd722064f4d', '021ffc34-a70f-41f5-84e5-11cbe6e07a3f', 'a4f8ac93-179f-4038-9989-850cca18c803', 'f92d8b62-2183-4af3-9987-47adcebc9758'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:19 devstack sudo[104413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:38:19 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] Acquiring lock "cinder-8efe7b1e-cdb4-4dc2-8d69-06d28b836101-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] Lock "cinder-8efe7b1e-cdb4-4dc2-8d69-06d28b836101-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:19 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd" returned: 0 in 0.785s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-quobyte-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd" released by "delete_volume" :: held 1.689s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] Acquiring lock "cinder-quobyte-8efe7b1e-cdb4-4dc2-8d69-06d28b836101" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] Acquiring lock "cinder-2924baff-51a0-44f0-9bf2-9dc0591c1469-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-8efe7b1e-cdb4-4dc2-8d69-06d28b836101" acquired by "delete_volume" :: waited 0.035s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] Lock "cinder-2924baff-51a0-44f0-9bf2-9dc0591c1469-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[524a37b9-71ed-4e7b-884f-47282a19c295]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8efe7b1e-cdb4-4dc2-8d69-06d28b836101 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Created reservations ['27010d15-6347-4b53-b0da-02b78d51722c', '9dfe7661-6b25-4d0f-8dbc-1b5b367f82ed', 'c5f2f49d-0a40-47aa-8a46-4e6fc8c97f5e', '2d1e4e05-b146-41e4-9548-537ce81bf1d7'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] Acquiring lock "cinder-quobyte-2924baff-51a0-44f0-9bf2-9dc0591c1469" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] Lock "cinder-quobyte-2924baff-51a0-44f0-9bf2-9dc0591c1469" acquired by "delete_volume" :: waited 0.031s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d63378f-6386-49f1-9dd3-d7ab07bbad54]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2924baff-51a0-44f0-9bf2-9dc0591c1469 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:19 devstack sudo[104416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8efe7b1e-cdb4-4dc2-8d69-06d28b836101
Jun 18 11:38:19 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:19 devstack sudo[104421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:38:19 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:19 devstack sudo[104418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2924baff-51a0-44f0-9bf2-9dc0591c1469
Jun 18 11:38:19 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:19 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.737s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:38:19 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] Deleted volume successfully.
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5a0b9f3f-cc25-454a-8d17-bdddbb1ca8e0 tempest-VolumesListTestJSON-1856963534 None] Lock "cinder-369380a9-8938-49a1-a24a-53f554c74b5c-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "cinder-499093c5-97c4-460b-82a7-11163565a374-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-499093c5-97c4-460b-82a7-11163565a374-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "cinder-quobyte-499093c5-97c4-460b-82a7-11163565a374" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-quobyte-499093c5-97c4-460b-82a7-11163565a374" acquired by "delete_volume" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a95260-f857-4d9d-b390-491c0648c9d9]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-499093c5-97c4-460b-82a7-11163565a374 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:20 devstack sudo[104424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-499093c5-97c4-460b-82a7-11163565a374
Jun 18 11:38:20 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:20 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8efe7b1e-cdb4-4dc2-8d69-06d28b836101" returned: 0 in 0.839s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8efe7b1e-cdb4-4dc2-8d69-06d28b836101 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:20 devstack sudo[104431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8efe7b1e-cdb4-4dc2-8d69-06d28b836101
Jun 18 11:38:20 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:20 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2924baff-51a0-44f0-9bf2-9dc0591c1469" returned: 0 in 0.891s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2924baff-51a0-44f0-9bf2-9dc0591c1469 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:20 devstack sudo[104439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2924baff-51a0-44f0-9bf2-9dc0591c1469
Jun 18 11:38:20 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:20 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.886s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:20 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:38:20 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Deleted volume successfully.
Jun 18 11:38:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-93c802bc-8c0c-43d2-9033-3bddc2fffd0e tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-6fd7595f-8f81-46e6-8b49-97bbb5b8d2bd-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:20 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-499093c5-97c4-460b-82a7-11163565a374" returned: 0 in 0.860s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-499093c5-97c4-460b-82a7-11163565a374 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:20 devstack sudo[104474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-499093c5-97c4-460b-82a7-11163565a374
Jun 18 11:38:20 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:21 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8efe7b1e-cdb4-4dc2-8d69-06d28b836101" returned: 0 in 0.824s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-8efe7b1e-cdb4-4dc2-8d69-06d28b836101" released by "delete_volume" :: held 1.738s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] Created reservations ['f1d86ebc-46f9-480b-a0c1-910840ca3618', '8e9af343-d2f2-433d-8f92-7f33f6582fab', 'b6932551-af60-4e33-9833-43c6a8cc3014', 'f1619adb-22b3-4f2a-8f72-8305fde333b3'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:38:21 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2924baff-51a0-44f0-9bf2-9dc0591c1469" returned: 0 in 0.776s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] Lock "cinder-quobyte-2924baff-51a0-44f0-9bf2-9dc0591c1469" released by "delete_volume" :: held 1.715s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:21 devstack sudo[104480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:38:21 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] Created reservations ['867a6eaf-aec6-4b2c-968a-5d71c5de7db5', '8eb4e933-77ee-4473-b21e-8732e0e6dd5c', '0db821bb-adda-4541-aca8-673e4980cc58', '7f29e2a6-7975-420e-b5f8-4170365be62f'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:21 devstack sudo[104483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:38:21 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:21 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-499093c5-97c4-460b-82a7-11163565a374" returned: 0 in 0.696s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-quobyte-499093c5-97c4-460b-82a7-11163565a374" released by "delete_volume" :: held 1.603s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] Acquiring lock "cinder-f642cadb-b49c-4498-8fba-d0eb809a74cc-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] Lock "cinder-f642cadb-b49c-4498-8fba-d0eb809a74cc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Created reservations ['c8255311-f149-4a0d-a1b9-ca48eb06cfe2', 'bfcd5a7b-5f86-4c3d-bb6e-9a01dd13ed77', '9f3b2a9d-4ebd-471c-8672-b3ca05449e6f', '1fa82fa9-a793-4537-a216-d94aff517162'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] Acquiring lock "cinder-quobyte-f642cadb-b49c-4498-8fba-d0eb809a74cc" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-f642cadb-b49c-4498-8fba-d0eb809a74cc" acquired by "delete_volume" :: waited 0.027s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb37aec-3e47-4a0c-8c93-a693bb8d113e]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f642cadb-b49c-4498-8fba-d0eb809a74cc {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] Acquiring lock "cinder-2bae1525-f119-46db-a744-f60ad9edd564-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] Lock "cinder-2bae1525-f119-46db-a744-f60ad9edd564-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:21 devstack sudo[104486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:38:21 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:21 devstack sudo[104485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f642cadb-b49c-4498-8fba-d0eb809a74cc
Jun 18 11:38:21 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] Acquiring lock "cinder-quobyte-2bae1525-f119-46db-a744-f60ad9edd564" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] Lock "cinder-quobyte-2bae1525-f119-46db-a744-f60ad9edd564" acquired by "delete_volume" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae3295f-cef0-4cbf-9777-8b94756c2b2d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2bae1525-f119-46db-a744-f60ad9edd564 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:22 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.879s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:38:22 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] Deleted volume successfully.
Jun 18 11:38:22 devstack sudo[104489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2bae1525-f119-46db-a744-f60ad9edd564
Jun 18 11:38:22 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fec6bac1-2dc9-4586-b53c-77ee35941008 tempest-VolumesGetTest-355417129 None] Lock "cinder-8efe7b1e-cdb4-4dc2-8d69-06d28b836101-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "cinder-128031b3-bda5-46af-bb62-a77fd9267eb6-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-128031b3-bda5-46af-bb62-a77fd9267eb6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "cinder-quobyte-128031b3-bda5-46af-bb62-a77fd9267eb6" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:22 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.007s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:38:22 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] Deleted volume successfully.
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-quobyte-128031b3-bda5-46af-bb62-a77fd9267eb6" acquired by "delete_volume" :: waited 0.048s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[599beeb6-fbe1-4517-9c3d-a6c41f5a519d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-128031b3-bda5-46af-bb62-a77fd9267eb6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c1bb1aac-2e16-4757-a49e-4cb1777a5ea4 tempest-VolumesListTestJSON-1856963534 None] Lock "cinder-2924baff-51a0-44f0-9bf2-9dc0591c1469-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:22 devstack sudo[104493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-128031b3-bda5-46af-bb62-a77fd9267eb6
Jun 18 11:38:22 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:22 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:22 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f642cadb-b49c-4498-8fba-d0eb809a74cc" returned: 0 in 0.928s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f642cadb-b49c-4498-8fba-d0eb809a74cc {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.904s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:38:22 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Deleted volume successfully.
Jun 18 11:38:22 devstack sudo[104499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f642cadb-b49c-4498-8fba-d0eb809a74cc
Jun 18 11:38:22 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b7fb9f44-2235-45e8-8351-98b78a2fec9f tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-499093c5-97c4-460b-82a7-11163565a374-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:22 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2bae1525-f119-46db-a744-f60ad9edd564" returned: 0 in 1.060s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2bae1525-f119-46db-a744-f60ad9edd564 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:23 devstack sudo[104504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2bae1525-f119-46db-a744-f60ad9edd564
Jun 18 11:38:23 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:23 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-128031b3-bda5-46af-bb62-a77fd9267eb6" returned: 0 in 0.831s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-128031b3-bda5-46af-bb62-a77fd9267eb6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:23 devstack sudo[104509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-128031b3-bda5-46af-bb62-a77fd9267eb6
Jun 18 11:38:23 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:23 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f642cadb-b49c-4498-8fba-d0eb809a74cc" returned: 0 in 0.726s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-f642cadb-b49c-4498-8fba-d0eb809a74cc" released by "delete_volume" :: held 1.718s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] Created reservations ['18706612-6669-40b4-9833-a65f1a4586c6', 'a615cc43-0cdb-4bc3-9d6a-1c2770902ce2', 'f8c0b76c-3d14-49d1-a8d0-9bace8184983', 'b02b8cdd-2176-4420-b23b-e39a8f254849'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:23 devstack sudo[104512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:38:23 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:23 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2bae1525-f119-46db-a744-f60ad9edd564" returned: 0 in 0.697s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] Lock "cinder-quobyte-2bae1525-f119-46db-a744-f60ad9edd564" released by "delete_volume" :: held 1.815s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] Created reservations ['5ca74fcc-0158-4f1f-8340-2a0ba4a77296', 'fd6ed444-0e26-4376-818d-31c4db8e79bd', '9c85ea37-909b-4c22-99e7-c38c2efe8ca6', 'b8d26f50-ff56-4eb9-9190-e890cc35b33d'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:23 devstack sudo[104516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:38:23 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:23 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-128031b3-bda5-46af-bb62-a77fd9267eb6" returned: 0 in 0.718s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-quobyte-128031b3-bda5-46af-bb62-a77fd9267eb6" released by "delete_volume" :: held 1.600s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Created reservations ['77530789-0ba1-464d-9b88-e94a88ff23d4', 'cd9220d5-a1df-441f-99ed-062f76e6c736', 'f8521f63-f556-4e25-8379-c94d11846e01', 'aa166043-78b3-445a-a19f-c6dd37016386'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:24 devstack sudo[104519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:38:24 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:24 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.953s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:38:24 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] Deleted volume successfully.
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1408bc5b-ea06-4a56-9afa-b18aba1ca8f6 tempest-VolumesGetTest-355417129 None] Lock "cinder-f642cadb-b49c-4498-8fba-d0eb809a74cc-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "cinder-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Flow 'volume_create_manager' (d988a1a3-fea2-4c0d-af1f-0e655c5af96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f74567-64bd-44ac-b92b-195fbbc46ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f74567-64bd-44ac-b92b-195fbbc46ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1166030151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80229cfc6efc4b7ab553b1225b3eeb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:25Z,use_quota=True,user_id='88790e9e355946e0b807c986a668f96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534dc4a8-6295-474f-901a-b940a3ec5394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534dc4a8-6295-474f-901a-b940a3ec5394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a147b1-f137-4393-8006-f4ab7285a640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a147b1-f137-4393-8006-f4ab7285a640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce', 'volume_name': 'volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf91450-6e32-4146-947e-8eca4e9af43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf91450-6e32-4146-947e-8eca4e9af43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e2a2f9-8a90-426c-8850-aca37ddd215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:24 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Volume cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce', 'volume_size': 1}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1166030151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80229cfc6efc4b7ab553b1225b3eeb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:25Z,use_quota=True,user_id='88790e9e355946e0b807c986a668f96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Creating volume cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:38:24 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:24 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:24 devstack sudo[104522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce 1073741824
Jun 18 11:38:24 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.946s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:38:24 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] Deleted volume successfully.
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "cinder-quobyte-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-quobyte-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af" acquired by "delete_volume" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0ddf721c-6c3d-423a-888a-2fa88da6c7c8 tempest-VolumesListTestJSON-1856963534 None] Lock "cinder-2bae1525-f119-46db-a744-f60ad9edd564-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6474b9d-2797-45c0-98c3-8069d6448ab4]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:24 devstack sudo[104524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af
Jun 18 11:38:24 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:25 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.851s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:25 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:38:25 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Deleted volume successfully.
Jun 18 11:38:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a46a96bf-1b96-49b1-8eef-2c73b71d1cf0 tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-128031b3-bda5-46af-bb62-a77fd9267eb6-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:38:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:25 devstack sudo[104530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:38:25 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:25 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce 1073741824" returned: 0 in 1.115s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:25 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af" returned: 0 in 1.041s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:25 devstack sudo[104536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce
Jun 18 11:38:25 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:25 devstack sudo[104537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af
Jun 18 11:38:25 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:26 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.896s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:38:26 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce" returned: 0 in 0.703s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e2a2f9-8a90-426c-8850-aca37ddd215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0209e08d-b52e-4fb1-a6da-5e75f845fa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:26 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Volume volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce (cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce): created successfully
Jun 18 11:38:26 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0209e08d-b52e-4fb1-a6da-5e75f845fa4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Flow 'volume_create_manager' (d988a1a3-fea2-4c0d-af1f-0e655c5af96f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af" returned: 0 in 0.751s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-quobyte-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af" released by "delete_volume" :: held 1.843s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:26 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-92196437-e57c-4fca-a3c4-a7181ca202e0 tempest-VolumesGetTest-355417129 None] Created volume successfully.
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Created reservations ['07d019ac-13b1-48d0-9d2e-c3b9f44ba2ea', '314f56ac-d3f4-4d81-a97c-cc295bb6f3b9', '01a75322-35f2-4a92-84b0-8778b31536ef', '34b52cca-13a3-4889-8bdf-167fb8543f06'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:26 devstack sudo[104543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:38:26 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:27 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.771s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:38:27 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Deleted volume successfully.
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ea41bdb6-04ef-4a6d-befc-3b0a45e25f1d tempest-CreateVolumesFromSourceVolumeTest-1167048604 None] Lock "cinder-35bb6e50-ebd9-4e6f-aa4d-d91d639f24af-delete_volume" released by "delete_volume" :: held 2.956s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Flow 'volume_create_manager' (f241401b-687a-48c8-b1a3-f3d057fe91a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57853afb-a4a3-475d-b365-90d4a95b7911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57853afb-a4a3-475d-b365-90d4a95b7911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2007610752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28abc70a-7e9d-44d4-9999-b14ce284b6ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05a30e7a6f94ab181ef17f35594ac82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:28Z,use_quota=True,user_id='28d81372253446f2a6aca1f0598e4be7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff84ee4-0a01-484b-affe-20fc06c23b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff84ee4-0a01-484b-affe-20fc06c23b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ac7d40-36dd-4c17-b370-6dd68869e70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ac7d40-36dd-4c17-b370-6dd68869e70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28abc70a-7e9d-44d4-9999-b14ce284b6ff', 'volume_name': 'volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01bef0e6-66fb-42f2-b484-404afc974a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01bef0e6-66fb-42f2-b484-404afc974a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97aa1b7-43c0-46a0-9cd2-bd0985c3866e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:27 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Volume 28abc70a-7e9d-44d4-9999-b14ce284b6ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff', 'volume_size': 1}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2007610752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28abc70a-7e9d-44d4-9999-b14ce284b6ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05a30e7a6f94ab181ef17f35594ac82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:28Z,use_quota=True,user_id='28d81372253446f2a6aca1f0598e4be7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Creating volume 28abc70a-7e9d-44d4-9999-b14ce284b6ff {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:38:27 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:38:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:27 devstack sudo[104546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff 1073741824
Jun 18 11:38:27 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:28 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:38:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Flow 'volume_create_manager' (4a7cc297-f7c3-42c8-b3db-6eb5683528e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbafd43-0c44-44c6-9370-64365ce1d6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbafd43-0c44-44c6-9370-64365ce1d6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-933650661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2277c91e-3482-48d3-9c95-79aedb9ba522,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='80229cfc6efc4b7ab553b1225b3eeb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:28Z,use_quota=True,user_id='88790e9e355946e0b807c986a668f96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097a2d5d-5546-4c96-b38e-9651bc7c8df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097a2d5d-5546-4c96-b38e-9651bc7c8df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0079cdb6-aa38-4dcf-a913-4ac73ca6775e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0079cdb6-aa38-4dcf-a913-4ac73ca6775e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2277c91e-3482-48d3-9c95-79aedb9ba522', 'volume_name': 'volume-2277c91e-3482-48d3-9c95-79aedb9ba522', 'volume_size': 1, 'source_volid': 'cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce', 'source_volstatus': 'available'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd04e36b-c712-472f-8482-1d7f1a50ac94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd04e36b-c712-472f-8482-1d7f1a50ac94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:28 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21723836-078f-4e80-97a6-5f7e0252255c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:28 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Volume 2277c91e-3482-48d3-9c95-79aedb9ba522: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2277c91e-3482-48d3-9c95-79aedb9ba522', 'volume_size': 1, 'source_volid': 'cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce', 'source_volstatus': 'available'}
Jun 18 11:38:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:28 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff 1073741824" returned: 0 in 0.947s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:28 devstack sudo[104552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff
Jun 18 11:38:28 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:29 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff" returned: 0 in 0.671s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:38:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.045s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:29 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Cloning volume cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce to volume 2277c91e-3482-48d3-9c95-79aedb9ba522
Jun 18 11:38:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97aa1b7-43c0-46a0-9cd2-bd0985c3866e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85bad09-5926-4c73-a1c0-cb896ca4b8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:29 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Volume volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff (28abc70a-7e9d-44d4-9999-b14ce284b6ff): created successfully
Jun 18 11:38:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85bad09-5926-4c73-a1c0-cb896ca4b8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Flow 'volume_create_manager' (f241401b-687a-48c8-b1a3-f3d057fe91a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Creating offline snapshot 9d8715f3-604b-4174-aceb-eaf9a8699674 of volume cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:38:29 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-a0a6fde6-272f-43a4-8166-722cbbdccbc4 tempest-VolumesSnapshotListTestJSON-891834788 None] Created volume successfully.
Jun 18 11:38:29 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d2aae5-3272-4bcc-a6ae-757713a6cbff]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:29 devstack sudo[104555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce
Jun 18 11:38:29 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:30 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:38:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Flow 'volume_create_manager' (b227fc6a-deee-48c3-8167-9767ed6ff971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d76f707-f024-4d54-9ae5-60f2b3191cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d76f707-f024-4d54-9ae5-60f2b3191cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-977340649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdc57a1-6a00-493c-b5b9-370584dc1009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93978ddc698d4ecba00a8a8f7c7a9598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:30Z,use_quota=True,user_id='6a40ef3aac0b4d70a0af4df742a2b018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579a4f79-c55b-46ec-a7c5-749428ea58d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579a4f79-c55b-46ec-a7c5-749428ea58d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420addea-e4cf-4bea-9fe4-3d03da063dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420addea-e4cf-4bea-9fe4-3d03da063dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cdc57a1-6a00-493c-b5b9-370584dc1009', 'volume_name': 'volume-7cdc57a1-6a00-493c-b5b9-370584dc1009', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432f97d2-5f67-4611-b7d2-ccb63c44753f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432f97d2-5f67-4611-b7d2-ccb63c44753f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7717770-abb0-4acc-a3ea-8744c562f874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:30 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Volume 7cdc57a1-6a00-493c-b5b9-370584dc1009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cdc57a1-6a00-493c-b5b9-370584dc1009', 'volume_size': 1}
Jun 18 11:38:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:30 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce" returned: 0 in 0.844s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:30 devstack sudo[104561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674 1G
Jun 18 11:38:30 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:31 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674 1G" returned: 0 in 0.797s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:31 devstack sudo[104566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674
Jun 18 11:38:31 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:31 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674" returned: 0 in 0.689s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:31 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674 is being set with open permissions: ugo+rw
Jun 18 11:38:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:31 devstack sudo[104571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674
Jun 18 11:38:31 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:32 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674" returned: 0 in 0.628s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:32 devstack sudo[104574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.info
Jun 18 11:38:32 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:33 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.info" returned: 0 in 0.650s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:33 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.info is being set with open permissions: ugo+rw
Jun 18 11:38:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:33 devstack sudo[104577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.info
Jun 18 11:38:33 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:33 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.info" returned: 0 in 0.648s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:33 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Acquiring lock "cinder-quobyte-2277c91e-3482-48d3-9c95-79aedb9ba522" by "_copy_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:33 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-2277c91e-3482-48d3-9c95-79aedb9ba522" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] snapshot: 9d8715f3-604b-4174-aceb-eaf9a8699674, volume: 2277c91e-3482-48d3-9c95-79aedb9ba522,  {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 18 11:38:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:33 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4397db-bd49-4dd4-869b-b1f8e41bdb21]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:33 devstack sudo[104580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674
Jun 18 11:38:33 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:34 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674" returned: 0 in 0.750s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:34 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:38:34 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 18 11:38:34 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Creating direct copy from snapshot {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 18 11:38:34 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4364061-8aa9-4cc4-a68e-b9c2af0ecfbb]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:34 devstack sudo[104585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce
Jun 18 11:38:34 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:35 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce" returned: 0 in 0.749s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:35 devstack cinder-volume[91663]: DEBUG cinder.utils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Path /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2277c91e-3482-48d3-9c95-79aedb9ba522 not found in is_blk_device check {{(pid=91663) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 18 11:38:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2277c91e-3482-48d3-9c95-79aedb9ba522 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:35 devstack sudo[104590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2277c91e-3482-48d3-9c95-79aedb9ba522
Jun 18 11:38:35 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:39 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2277c91e-3482-48d3-9c95-79aedb9ba522" returned: 0 in 4.560s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:39 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7c6748-6908-42e1-89a9-63740cdeb356]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:40 devstack sudo[104604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce
Jun 18 11:38:40 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:40 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce" returned: 0 in 0.897s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:40 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce, size 1024.00 MB, duration 4.56 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2277c91e-3482-48d3-9c95-79aedb9ba522 {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:38:40 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Converted 1024.00 MB image at 224.52 MB/s
Jun 18 11:38:40 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2277c91e-3482-48d3-9c95-79aedb9ba522 is being set with open permissions: ugo+rw
Jun 18 11:38:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2277c91e-3482-48d3-9c95-79aedb9ba522 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:40 devstack sudo[104609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2277c91e-3482-48d3-9c95-79aedb9ba522
Jun 18 11:38:40 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:41 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2277c91e-3482-48d3-9c95-79aedb9ba522" returned: 0 in 0.618s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-2277c91e-3482-48d3-9c95-79aedb9ba522" released by "_copy_volume_from_snapshot" :: held 7.652s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Acquiring lock "cinder-quobyte-9d8715f3-604b-4174-aceb-eaf9a8699674" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-9d8715f3-604b-4174-aceb-eaf9a8699674" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Deleting offline snapshot 9d8715f3-604b-4174-aceb-eaf9a8699674 of volume cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:38:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] snapshot_file for this snap is: volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:38:41 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4a9cd7-3944-470b-996d-c7d0ef122f8e]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:41 devstack sudo[104612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674
Jun 18 11:38:41 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:42 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674" returned: 0 in 0.739s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:38:42 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[62944a00-c8e5-4f58-9e39-c9c9bc52c10d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:42 devstack sudo[104617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce
Jun 18 11:38:42 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:42 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=126,cinder:UPDATE=185,cinder:INSERT=47,cinder:DELETE=16 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:38:43 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce" returned: 0 in 0.747s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:43 devstack sudo[104622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674
Jun 18 11:38:43 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:43 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674" returned: 0 in 0.717s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:43 devstack sudo[104628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674
Jun 18 11:38:43 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:44 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce.9d8715f3-604b-4174-aceb-eaf9a8699674" returned: 0 in 0.648s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:44 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-9d8715f3-604b-4174-aceb-eaf9a8699674" released by "_delete_snapshot" :: held 2.942s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:44 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=113,cinder:INSERT=40,cinder:UPDATE=171,cinder:DELETE=15 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:38:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.059s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.302s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] Creating offline snapshot c55960a3-7ed8-459d-9476-eead39a2fcf6 of volume 28abc70a-7e9d-44d4-9999-b14ce284b6ff {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:38:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21723836-078f-4e80-97a6-5f7e0252255c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2277c91e-3482-48d3-9c95-79aedb9ba522', 'volume_size': 1, 'source_volid': 'cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce', 'source_volstatus': 'available'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc1fee2-66fa-4758-ab03-e38b430c65e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:44 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ff45d4-9922-4a65-9f4f-3a5a09714776]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:44 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Volume volume-2277c91e-3482-48d3-9c95-79aedb9ba522 (2277c91e-3482-48d3-9c95-79aedb9ba522): created successfully
Jun 18 11:38:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc1fee2-66fa-4758-ab03-e38b430c65e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Flow 'volume_create_manager' (4a7cc297-f7c3-42c8-b3db-6eb5683528e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:44 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-b2e3b690-34ac-4b54-a754-84b4d07cebda tempest-VolumesGetTest-355417129 None] Created volume successfully.
Jun 18 11:38:44 devstack sudo[104631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff
Jun 18 11:38:44 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:45 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff" returned: 0 in 0.763s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:45 devstack sudo[104636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6 1G
Jun 18 11:38:45 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:46 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:38:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Flow 'volume_create_manager' (15a30ba6-2e12-4dd2-a0d4-7cdb64b21858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5ef268-bd35-4eff-a187-3c14e99df592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5ef268-bd35-4eff-a187-3c14e99df592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-976916043',display_name='tempest-VolumesGetTest-Volume-1378252246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec51e78-e560-4a7b-b0b6-bfa8b449dd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80229cfc6efc4b7ab553b1225b3eeb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:46Z,use_quota=True,user_id='88790e9e355946e0b807c986a668f96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8785cc6-1c48-47a2-b27e-07289986fff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8785cc6-1c48-47a2-b27e-07289986fff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d03f08-d3a9-4ba7-a737-64879f713ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d03f08-d3a9-4ba7-a737-64879f713ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ec51e78-e560-4a7b-b0b6-bfa8b449dd53', 'volume_name': 'volume-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7202f701-b9bc-437e-a801-b3e9d05ad940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7202f701-b9bc-437e-a801-b3e9d05ad940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35e0c42-5d62-4423-b206-fa19992fefc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:46 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Volume 8ec51e78-e560-4a7b-b0b6-bfa8b449dd53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53', 'volume_size': 1}
Jun 18 11:38:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:46 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6 1G" returned: 0 in 0.872s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:46 devstack sudo[104642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6
Jun 18 11:38:46 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:46 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6" returned: 0 in 0.677s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:46 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6 is being set with open permissions: ugo+rw
Jun 18 11:38:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:46 devstack sudo[104647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6
Jun 18 11:38:46 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:47 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6" returned: 0 in 0.629s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:47 devstack sudo[104650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.info
Jun 18 11:38:47 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:48 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.info" returned: 0 in 0.621s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:48 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.info is being set with open permissions: ugo+rw
Jun 18 11:38:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:48 devstack sudo[104653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.info
Jun 18 11:38:48 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:48 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.info" returned: 0 in 0.645s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.294s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.485s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-977340649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdc57a1-6a00-493c-b5b9-370584dc1009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93978ddc698d4ecba00a8a8f7c7a9598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:30Z,use_quota=True,user_id='6a40ef3aac0b4d70a0af4df742a2b018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:38:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Creating volume 7cdc57a1-6a00-493c-b5b9-370584dc1009 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:38:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:38:48 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:38:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:48 devstack sudo[104656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 1073741824
Jun 18 11:38:48 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:48 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-42ee56c6-11a3-4e52-ac09-9118b63a5957 tempest-VolumesSnapshotListTestJSON-891834788 None] Create snapshot completed successfully
Jun 18 11:38:49 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 1073741824" returned: 0 in 0.820s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:49 devstack sudo[104662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009
Jun 18 11:38:49 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-02c1b9bd-3b63-44ed-806d-83e169f300ff tempest-VolumesSnapshotListTestJSON-891834788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:50 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009" returned: 0 in 0.669s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:38:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.208s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:38:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-976916043',display_name='tempest-VolumesGetTest-Volume-1378252246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec51e78-e560-4a7b-b0b6-bfa8b449dd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80229cfc6efc4b7ab553b1225b3eeb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:38:46Z,use_quota=True,user_id='88790e9e355946e0b807c986a668f96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:38:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Creating volume 8ec51e78-e560-4a7b-b0b6-bfa8b449dd53 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:38:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:38:50 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:38:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7717770-abb0-4acc-a3ea-8744c562f874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cdc57a1-6a00-493c-b5b9-370584dc1009', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:50 devstack sudo[104665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53 1073741824
Jun 18 11:38:50 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a973216f-a7ef-4cce-b697-68c92f44177f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:50 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Volume volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 (7cdc57a1-6a00-493c-b5b9-370584dc1009): created successfully
Jun 18 11:38:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a973216f-a7ef-4cce-b697-68c92f44177f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Flow 'volume_create_manager' (b227fc6a-deee-48c3-8167-9767ed6ff971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:50 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-dea54b90-13db-49b6-96a4-70ebcddc5d03 tempest-VolumeDependencyTests-1428559713 None] Created volume successfully.
Jun 18 11:38:51 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53 1073741824" returned: 0 in 0.793s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:51 devstack sudo[104671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53
Jun 18 11:38:51 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:51 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53" returned: 0 in 0.640s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:51 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:38:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-02c1b9bd-3b63-44ed-806d-83e169f300ff tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.974s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:51 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35e0c42-5d62-4423-b206-fa19992fefc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:51 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81696402-99ec-442c-9df4-3377d61d18d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:38:51 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-02c1b9bd-3b63-44ed-806d-83e169f300ff tempest-VolumesSnapshotListTestJSON-891834788 None] Creating offline snapshot f84d859f-d0f3-42f5-ad30-625b9f68b51b of volume 28abc70a-7e9d-44d4-9999-b14ce284b6ff {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:38:51 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Volume volume-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53 (8ec51e78-e560-4a7b-b0b6-bfa8b449dd53): created successfully
Jun 18 11:38:51 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81696402-99ec-442c-9df4-3377d61d18d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:38:51 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Flow 'volume_create_manager' (15a30ba6-2e12-4dd2-a0d4-7cdb64b21858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:38:51 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd17595d-e849-491b-bc9b-2e170a74cf69]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-02c1b9bd-3b63-44ed-806d-83e169f300ff tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:51 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d12aba9e-45ff-4ab0-a789-b8644b0c3e0d tempest-VolumesGetTest-355417129 None] Created volume successfully.
Jun 18 11:38:52 devstack sudo[104674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6
Jun 18 11:38:52 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] Acquiring lock "cinder-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] Lock "cinder-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] Acquiring lock "cinder-quobyte-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53" acquired by "delete_volume" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:52 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbf58f3-1c8e-4c96-bc73-639b7451ee9f]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:52 devstack sudo[104678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53
Jun 18 11:38:52 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:52 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-02c1b9bd-3b63-44ed-806d-83e169f300ff tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6" returned: 0 in 0.790s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-02c1b9bd-3b63-44ed-806d-83e169f300ff tempest-VolumesSnapshotListTestJSON-891834788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:38:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-02c1b9bd-3b63-44ed-806d-83e169f300ff tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:52 devstack sudo[104681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b 1G
Jun 18 11:38:52 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:53 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53" returned: 0 in 0.790s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:53 devstack sudo[104689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53
Jun 18 11:38:53 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:53 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-02c1b9bd-3b63-44ed-806d-83e169f300ff tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b 1G" returned: 0 in 0.805s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-02c1b9bd-3b63-44ed-806d-83e169f300ff tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:53 devstack sudo[104691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b
Jun 18 11:38:53 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:54 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53" returned: 0 in 0.688s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53" released by "delete_volume" :: held 1.519s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] Created reservations ['a803373d-e699-4439-9895-7b6a584c42ec', 'a42c4132-3c27-4af2-8c70-46a5d57b75c4', '6c262ef4-8271-4b54-a532-6629bd2ddfa5', '540d66e2-2497-4d06-9ed4-b3a500c19209'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:54 devstack sudo[104698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:38:54 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:54 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-02c1b9bd-3b63-44ed-806d-83e169f300ff tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b" returned: 0 in 0.690s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:54 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-02c1b9bd-3b63-44ed-806d-83e169f300ff tempest-VolumesSnapshotListTestJSON-891834788 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b is being set with open permissions: ugo+rw
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-02c1b9bd-3b63-44ed-806d-83e169f300ff tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:54 devstack sudo[104700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b
Jun 18 11:38:54 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] Acquiring lock "cinder-2277c91e-3482-48d3-9c95-79aedb9ba522-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] Lock "cinder-2277c91e-3482-48d3-9c95-79aedb9ba522-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:54 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.654s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:38:54 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] Deleted volume successfully.
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] Acquiring lock "cinder-quobyte-2277c91e-3482-48d3-9c95-79aedb9ba522" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-2277c91e-3482-48d3-9c95-79aedb9ba522" acquired by "delete_volume" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d0cb4913-a04d-4b34-bb8e-a79637c96fc8 tempest-VolumesGetTest-355417129 None] Lock "cinder-8ec51e78-e560-4a7b-b0b6-bfa8b449dd53-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[9265f452-2b0e-4863-9774-c7b37d7c83a3]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2277c91e-3482-48d3-9c95-79aedb9ba522 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:54 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-02c1b9bd-3b63-44ed-806d-83e169f300ff tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b" returned: 0 in 0.687s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-02c1b9bd-3b63-44ed-806d-83e169f300ff tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.100s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.275s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] Creating offline snapshot 495074d5-1003-45f9-9e8d-03a7172948b6 of volume 7cdc57a1-6a00-493c-b5b9-370584dc1009 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:38:54 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-02c1b9bd-3b63-44ed-806d-83e169f300ff tempest-VolumesSnapshotListTestJSON-891834788 None] Create snapshot completed successfully
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab18266-4152-48c2-9b62-7d640a2e9964]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:54 devstack sudo[104704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2277c91e-3482-48d3-9c95-79aedb9ba522
Jun 18 11:38:54 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:55 devstack sudo[104705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009
Jun 18 11:38:55 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a9c8d9d3-8407-44cc-b19a-fa1d61c9e039 tempest-VolumesSnapshotListTestJSON-891834788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:55 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2277c91e-3482-48d3-9c95-79aedb9ba522" returned: 0 in 0.773s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2277c91e-3482-48d3-9c95-79aedb9ba522 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:55 devstack sudo[104714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2277c91e-3482-48d3-9c95-79aedb9ba522
Jun 18 11:38:55 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:55 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009" returned: 0 in 0.804s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:55 devstack sudo[104716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6 1G
Jun 18 11:38:55 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:56 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2277c91e-3482-48d3-9c95-79aedb9ba522" returned: 0 in 0.640s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:56 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-2277c91e-3482-48d3-9c95-79aedb9ba522" released by "delete_volume" :: held 1.457s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:56 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] Created reservations ['70885243-8a0a-47f8-a170-091c602ab971', 'f09bfb16-09d6-4e8c-81bb-c21b94b51253', '57208045-67fb-4804-be88-33b25ef41c2f', '9a645e72-9f5d-4507-a59b-ae51aa8ec1d2'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:38:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:56 devstack sudo[104722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:38:56 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:56 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6 1G" returned: 0 in 0.812s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:56 devstack sudo[104725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6
Jun 18 11:38:56 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] Acquiring lock "cinder-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] Lock "cinder-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:57 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.678s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:57 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:38:57 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] Deleted volume successfully.
Jun 18 11:38:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] Acquiring lock "cinder-quobyte-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:38:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0f0d4736-afe2-4ae3-b6a1-6ca7ffc293f6 tempest-VolumesGetTest-355417129 None] Lock "cinder-2277c91e-3482-48d3-9c95-79aedb9ba522-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce" acquired by "delete_volume" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:38:57 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1d73da-fbae-42cc-8173-f218c40a2374]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:57 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6" returned: 0 in 0.711s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:57 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6 is being set with open permissions: ugo+rw
Jun 18 11:38:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:57 devstack sudo[104731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce
Jun 18 11:38:57 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:57 devstack sudo[104732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6
Jun 18 11:38:57 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:57 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6" returned: 0 in 0.633s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:57 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce" returned: 0 in 0.800s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:57 devstack sudo[104739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.info
Jun 18 11:38:58 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:58 devstack sudo[104740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce
Jun 18 11:38:58 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:58 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:58 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.info" returned: 0 in 0.657s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:58 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.info is being set with open permissions: ugo+rw
Jun 18 11:38:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce" returned: 0 in 0.659s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:58 devstack sudo[104745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.info
Jun 18 11:38:58 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce" released by "delete_volume" :: held 1.523s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:58 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] Created reservations ['b593af3a-f373-41ab-a25b-ad57aadcb692', 'b73c1323-0b5d-41e7-abea-ed46cc594ca5', 'b9a8dc86-7a4d-4bf7-be98-56fc6c0d9763', 'ab42b4b3-2fd6-4280-8054-8dc7cd028255'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:38:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:38:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:38:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:38:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:58 devstack sudo[104747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:38:58 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:59 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.info" returned: 0 in 0.646s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.378s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:38:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a9c8d9d3-8407-44cc-b19a-fa1d61c9e039 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.060s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:38:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-a9c8d9d3-8407-44cc-b19a-fa1d61c9e039 tempest-VolumesSnapshotListTestJSON-891834788 None] Creating offline snapshot c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad of volume 28abc70a-7e9d-44d4-9999-b14ce284b6ff {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:38:59 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-338c1d02-6244-40b0-adea-cdef47b3d97c tempest-VolumeDependencyTests-1428559713 None] Create snapshot completed successfully
Jun 18 11:38:59 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[9235bd7b-3dac-494f-84e7-6104dd7e82cd]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:38:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a9c8d9d3-8407-44cc-b19a-fa1d61c9e039 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:38:59 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root
Jun 18 11:38:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.698s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:38:59 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:38:59 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] Deleted volume successfully.
Jun 18 11:38:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7bca020d-d4ba-42bc-9c92-7adeb3f422f5 tempest-VolumesGetTest-355417129 None] Lock "cinder-cc25a8bf-a9b9-4b99-b193-c77a2cbb81ce-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:38:59 devstack sudo[104751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b
Jun 18 11:38:59 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:38:59 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Flow 'volume_create_manager' (1a19c07b-7276-4d1b-9dd2-d74364eb5d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92bbba6-6467-4938-b22c-b8637c253eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92bbba6-6467-4938-b22c-b8637c253eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1984837980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348054b2-d47c-4bce-8908-6342a4b493a0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='80229cfc6efc4b7ab553b1225b3eeb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:39:00Z,use_quota=True,user_id='88790e9e355946e0b807c986a668f96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe2bc39-c5f6-4b2c-a982-0960e528aaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe2bc39-c5f6-4b2c-a982-0960e528aaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35bc32ab-f776-44eb-96cb-bf87c6bb891a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.image.glance [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Creating Keystone auth plugin from conf {{(pid=91663) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 18 11:39:00 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a9c8d9d3-8407-44cc-b19a-fa1d61c9e039 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b" returned: 0 in 0.808s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-a9c8d9d3-8407-44cc-b19a-fa1d61c9e039 tempest-VolumesSnapshotListTestJSON-891834788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a9c8d9d3-8407-44cc-b19a-fa1d61c9e039 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:00 devstack sudo[104758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad 1G
Jun 18 11:39:00 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35bc32ab-f776-44eb-96cb-bf87c6bb891a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '348054b2-d47c-4bce-8908-6342a4b493a0', 'volume_name': 'volume-348054b2-d47c-4bce-8908-6342a4b493a0', 'volume_size': 1, 'image_id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767e7f9d16154dd1a44a1bc208ee9108', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'created_at': datetime.datetime(2026, 6, 18, 9, 18, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 18, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ff0fa5160>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72473e36-750c-4dbb-8b69-a76cd846bb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72473e36-750c-4dbb-8b69-a76cd846bb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60792d57-915b-47e2-b9c4-d28549828c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:00 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Volume 348054b2-d47c-4bce-8908-6342a4b493a0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-348054b2-d47c-4bce-8908-6342a4b493a0', 'volume_size': 1, 'image_id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767e7f9d16154dd1a44a1bc208ee9108', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'created_at': datetime.datetime(2026, 6, 18, 9, 18, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 18, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ff0fa5160>}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Trying to clone 348054b2-d47c-4bce-8908-6342a4b493a0 from image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 at location (None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}]). {{(pid=91663) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Flow 'volume_create_manager' (809117b1-da7c-426b-b72f-9379e0973c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370525f8-5d24-4a48-b57b-5f27d7529517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370525f8-5d24-4a48-b57b-5f27d7529517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2003159575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fabf23c-8bd3-4964-879b-ba89e78b9aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93978ddc698d4ecba00a8a8f7c7a9598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=495074d5-1003-45f9-9e8d-03a7172948b6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:39:00Z,use_quota=True,user_id='6a40ef3aac0b4d70a0af4df742a2b018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bbcb600-4413-4ab2-a798-f0d87ce1de00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bbcb600-4413-4ab2-a798-f0d87ce1de00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed76e593-5ca8-4a7a-b4ad-717dcf7f94fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed76e593-5ca8-4a7a-b4ad-717dcf7f94fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7fabf23c-8bd3-4964-879b-ba89e78b9aea', 'volume_name': 'volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea', 'volume_size': 1, 'snapshot_id': '495074d5-1003-45f9-9e8d-03a7172948b6'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbaf42db-2e32-482e-9c25-9b41c4ced93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbaf42db-2e32-482e-9c25-9b41c4ced93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998579bc-8b77-47a7-9210-286e5dd587fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:00 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Volume 7fabf23c-8bd3-4964-879b-ba89e78b9aea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea', 'volume_size': 1, 'snapshot_id': '495074d5-1003-45f9-9e8d-03a7172948b6'}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b1i2yoo2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 18 11:39:00 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Image download 20.69 MB at 20.69 MB/s
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcae174-2b1f-4eea-afe4-35c66ab41833]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b1i2yoo2devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:00 devstack sudo[104763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b1i2yoo2devstack@QuobyteHD
Jun 18 11:39:00 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:01 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a9c8d9d3-8407-44cc-b19a-fa1d61c9e039 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad 1G" returned: 0 in 0.957s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a9c8d9d3-8407-44cc-b19a-fa1d61c9e039 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:01 devstack sudo[104766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad
Jun 18 11:39:01 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:01 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b1i2yoo2devstack@QuobyteHD" returned: 0 in 0.759s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:01 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Temporary image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 is fetched for user 88790e9e355946e0b807c986a668f96e. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 18 11:39:01 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[5249bfa3-2333-4f30-8295-22c4b2cbd7b7]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b1i2yoo2devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:01 devstack sudo[104771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b1i2yoo2devstack@QuobyteHD
Jun 18 11:39:01 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:01 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a9c8d9d3-8407-44cc-b19a-fa1d61c9e039 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad" returned: 0 in 0.688s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:01 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-a9c8d9d3-8407-44cc-b19a-fa1d61c9e039 tempest-VolumesSnapshotListTestJSON-891834788 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad is being set with open permissions: ugo+rw
Jun 18 11:39:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a9c8d9d3-8407-44cc-b19a-fa1d61c9e039 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:01 devstack sudo[104776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad
Jun 18 11:39:01 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:02 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b1i2yoo2devstack@QuobyteHD" returned: 0 in 0.753s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:02 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a9c8d9d3-8407-44cc-b19a-fa1d61c9e039 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad" returned: 0 in 0.629s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a9c8d9d3-8407-44cc-b19a-fa1d61c9e039 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.224s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.861s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Acquiring lock "cinder-quobyte-495074d5-1003-45f9-9e8d-03a7172948b6-7fabf23c-8bd3-4964-879b-ba89e78b9aea" by "_create_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-quobyte-495074d5-1003-45f9-9e8d-03a7172948b6-7fabf23c-8bd3-4964-879b-ba89e78b9aea" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Creating volume 7fabf23c-8bd3-4964-879b-ba89e78b9aea from snapshot 495074d5-1003-45f9-9e8d-03a7172948b6 {{(pid=91663) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Acquiring lock "cinder-quobyte-7fabf23c-8bd3-4964-879b-ba89e78b9aea" by "_copy_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:02 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-a9c8d9d3-8407-44cc-b19a-fa1d61c9e039 tempest-VolumesSnapshotListTestJSON-891834788 None] Create snapshot completed successfully
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-quobyte-7fabf23c-8bd3-4964-879b-ba89e78b9aea" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] snapshot: 495074d5-1003-45f9-9e8d-03a7172948b6, volume: 7fabf23c-8bd3-4964-879b-ba89e78b9aea,  {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5281ea-e305-4992-9fd4-47817c964a90]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:02 devstack sudo[104782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6
Jun 18 11:39:02 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:03 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6" returned: 0 in 0.730s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cdc57a1-6a00-493c-b5b9-370584dc1009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:39:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 18 11:39:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Creating direct copy from snapshot {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 18 11:39:03 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7bfa04-a091-4dd8-87de-682500f70b82]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:03 devstack sudo[104789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009
Jun 18 11:39:03 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:04 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009" returned: 0 in 0.802s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:04 devstack cinder-volume[91663]: DEBUG cinder.utils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Path /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea not found in is_blk_device check {{(pid=91663) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 18 11:39:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:04 devstack sudo[104794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea
Jun 18 11:39:04 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:04 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Acquiring lock "cinder-c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:04 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:04 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Acquiring lock "cinder-quobyte-28abc70a-7e9d-44d4-9999-b14ce284b6ff" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:04 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-quobyte-28abc70a-7e9d-44d4-9999-b14ce284b6ff" acquired by "delete_snapshot" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:04 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Acquiring lock "cinder-quobyte-c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:04 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-quobyte-c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:04 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Deleting offline snapshot c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad of volume 28abc70a-7e9d-44d4-9999-b14ce284b6ff {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:39:04 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] snapshot_file for this snap is: volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:39:04 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf6a07d-dc3c-465b-8fe9-050c6c0f0e77]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:04 devstack sudo[104796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad
Jun 18 11:39:04 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:05 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad" returned: 0 in 1.223s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:39:05 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2af2e1-a8fa-4154-b9af-2ffc2a02050c]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:05 devstack sudo[104811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b
Jun 18 11:39:05 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:06 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b" returned: 0 in 1.295s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:39:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:07 devstack sudo[104823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad
Jun 18 11:39:07 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:08 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad" returned: 0 in 1.854s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:08 devstack sudo[104833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad
Jun 18 11:39:08 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:09 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea" returned: 0 in 4.983s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:09 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8c422c-ea66-44e5-8f32-9712e5661d73]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:09 devstack sudo[104835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009
Jun 18 11:39:09 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:09 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad" returned: 0 in 0.748s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-quobyte-c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad" released by "_delete_snapshot" :: held 5.264s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-quobyte-28abc70a-7e9d-44d4-9999-b14ce284b6ff" released by "delete_snapshot" :: held 5.287s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:09 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Created reservations ['57811e1f-9b15-4b67-80d0-6463daa4988d', '0f1ed97c-da76-493b-990b-7275cd9fd6be', '233003fa-9ab8-44df-a210-3022b343b7a8', '17cdef52-bb8a-4133-aed6-3d732730ae38'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:39:09 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Delete snapshot completed successfully.
Jun 18 11:39:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cf4acef8-5e90-4eb3-9ca4-1a9157eb5d96 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-c30b93ed-7cdc-43d9-95ed-1b1a9a6bb0ad-delete_snapshot" released by "delete_snapshot" :: held 5.444s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:10 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009" returned: 0 in 0.913s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009, size 1024.00 MB, duration 4.98 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:39:10 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Converted 1024.00 MB image at 205.46 MB/s
Jun 18 11:39:10 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea is being set with open permissions: ugo+rw
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:10 devstack sudo[104842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea
Jun 18 11:39:10 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:10 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea" returned: 0 in 0.644s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-quobyte-7fabf23c-8bd3-4964-879b-ba89e78b9aea" released by "_copy_volume_from_snapshot" :: held 8.160s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-quobyte-495074d5-1003-45f9-9e8d-03a7172948b6-7fabf23c-8bd3-4964-879b-ba89e78b9aea" released by "_create_volume_from_snapshot" :: held 8.191s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.212s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.285s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1984837980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348054b2-d47c-4bce-8908-6342a4b493a0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='80229cfc6efc4b7ab553b1225b3eeb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:39:00Z,use_quota=True,user_id='88790e9e355946e0b807c986a668f96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Creating volume 348054b2-d47c-4bce-8908-6342a4b493a0 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:39:10 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Acquiring lock "cinder-f84d859f-d0f3-42f5-ad30-625b9f68b51b-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:10 devstack sudo[104845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0 1073741824
Jun 18 11:39:10 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-f84d859f-d0f3-42f5-ad30-625b9f68b51b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Acquiring lock "cinder-quobyte-28abc70a-7e9d-44d4-9999-b14ce284b6ff" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998579bc-8b77-47a7-9210-286e5dd587fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea', 'volume_size': 1, 'snapshot_id': '495074d5-1003-45f9-9e8d-03a7172948b6'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130c7ab4-d6d4-447f-925a-6bc60321a0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-quobyte-28abc70a-7e9d-44d4-9999-b14ce284b6ff" acquired by "delete_snapshot" :: waited 0.027s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Acquiring lock "cinder-quobyte-f84d859f-d0f3-42f5-ad30-625b9f68b51b" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:10 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Volume volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea (7fabf23c-8bd3-4964-879b-ba89e78b9aea): created successfully
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130c7ab4-d6d4-447f-925a-6bc60321a0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Flow 'volume_create_manager' (809117b1-da7c-426b-b72f-9379e0973c2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-quobyte-f84d859f-d0f3-42f5-ad30-625b9f68b51b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Deleting offline snapshot f84d859f-d0f3-42f5-ad30-625b9f68b51b of volume 28abc70a-7e9d-44d4-9999-b14ce284b6ff {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] snapshot_file for this snap is: volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:39:10 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-6a2d1619-3708-442b-97c6-b59cf207700a tempest-VolumeDependencyTests-1428559713 None] Created volume successfully.
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[8551147c-9050-4b00-b244-e2c6b8ea2b9d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:11 devstack sudo[104847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b
Jun 18 11:39:11 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] Acquiring lock "cinder-495074d5-1003-45f9-9e8d-03a7172948b6-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-495074d5-1003-45f9-9e8d-03a7172948b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] Acquiring lock "cinder-quobyte-7cdc57a1-6a00-493c-b5b9-370584dc1009" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-quobyte-7cdc57a1-6a00-493c-b5b9-370584dc1009" acquired by "delete_snapshot" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] Acquiring lock "cinder-quobyte-495074d5-1003-45f9-9e8d-03a7172948b6" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-quobyte-495074d5-1003-45f9-9e8d-03a7172948b6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] Deleting offline snapshot 495074d5-1003-45f9-9e8d-03a7172948b6 of volume 7cdc57a1-6a00-493c-b5b9-370584dc1009 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:39:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] snapshot_file for this snap is: volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:39:11 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfbfc9e-00eb-440a-b33e-0d9cd9e26fa3]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:11 devstack sudo[104852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6
Jun 18 11:39:11 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:11 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0 1073741824" returned: 0 in 0.884s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:11 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b" returned: 0 in 0.803s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:39:11 devstack sudo[104858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0
Jun 18 11:39:11 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:11 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00a62b6-f7fe-4bea-986a-7906550015f6]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:11 devstack sudo[104860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6
Jun 18 11:39:11 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:12 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6" returned: 0 in 0.804s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cdc57a1-6a00-493c-b5b9-370584dc1009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:39:12 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cf6000-e96e-4689-92f4-97696974ad27]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:12 devstack sudo[104866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009
Jun 18 11:39:12 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:12 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0" returned: 0 in 0.677s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:39:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:12 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Attempting download of 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 ((None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}])) to volume 348054b2-d47c-4bce-8908-6342a4b493a0. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 18 11:39:12 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[03da8765-666a-44a4-acd9-03b058a680fb]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_pn2ajy25 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:12 devstack sudo[104871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_pn2ajy25
Jun 18 11:39:12 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:12 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6" returned: 0 in 0.828s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:39:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:12 devstack sudo[104873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b
Jun 18 11:39:12 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:13 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009" returned: 0 in 0.794s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:13 devstack sudo[104879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6
Jun 18 11:39:13 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:13 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_pn2ajy25" returned: 0 in 0.745s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_pn2ajy25 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:13 devstack sudo[104886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_pn2ajy25
Jun 18 11:39:13 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:13 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b" returned: 0 in 0.761s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:13 devstack sudo[104888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b
Jun 18 11:39:13 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:13 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6" returned: 0 in 0.780s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:13 devstack sudo[104893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6
Jun 18 11:39:13 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:13 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_pn2ajy25" returned: 1 in 0.739s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_pn2ajy25' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:39:13 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f841518-eee5-4827-b10f-329433936f6d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b1i2yoo2devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:13 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.f84d859f-d0f3-42f5-ad30-625b9f68b51b" returned: 0 in 0.665s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-quobyte-f84d859f-d0f3-42f5-ad30-625b9f68b51b" released by "_delete_snapshot" :: held 3.159s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-quobyte-28abc70a-7e9d-44d4-9999-b14ce284b6ff" released by "delete_snapshot" :: held 3.195s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:14 devstack sudo[104898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b1i2yoo2devstack@QuobyteHD
Jun 18 11:39:14 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:14 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Created reservations ['dd24e7b1-ea6c-4aa4-8ef6-10912740cc22', 'ea7543ef-733d-45af-9641-f61a07301018', '15ee5c71-360f-4315-bcf8-198d572f5f7d', '9c5beaa2-030f-476e-aa0a-68a9a0d4c296'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:39:14 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Delete snapshot completed successfully.
Jun 18 11:39:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5c82f52e-25bc-48c9-be87-f9a9b05b4b05 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-f84d859f-d0f3-42f5-ad30-625b9f68b51b-delete_snapshot" released by "delete_snapshot" :: held 3.345s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:14 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009.495074d5-1003-45f9-9e8d-03a7172948b6" returned: 0 in 0.666s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-quobyte-495074d5-1003-45f9-9e8d-03a7172948b6" released by "_delete_snapshot" :: held 3.154s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-quobyte-7cdc57a1-6a00-493c-b5b9-370584dc1009" released by "delete_snapshot" :: held 3.180s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:14 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] Created reservations ['cfa90fca-783b-4aa0-aa04-bd63ea775d05', '6cf7ff80-dc26-4d17-a847-f024b49b4423', '8a0e488f-0129-45be-97cc-458f1bbcf2eb', '5179a596-4a6b-4e03-a304-43c14290f379'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:39:14 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] Delete snapshot completed successfully.
Jun 18 11:39:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-5d7b127a-ad8d-4acd-82f9-9c737960fe14 tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-495074d5-1003-45f9-9e8d-03a7172948b6-delete_snapshot" released by "delete_snapshot" :: held 3.305s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:14 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b1i2yoo2devstack@QuobyteHD" returned: 0 in 0.774s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:14 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 was qcow2, converting to raw {{(pid=91663) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 18 11:39:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b1i2yoo2devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:14 devstack sudo[104904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b1i2yoo2devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0
Jun 18 11:39:14 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] Acquiring lock "cinder-c55960a3-7ed8-459d-9476-eead39a2fcf6-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-c55960a3-7ed8-459d-9476-eead39a2fcf6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] Acquiring lock "cinder-quobyte-28abc70a-7e9d-44d4-9999-b14ce284b6ff" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-quobyte-28abc70a-7e9d-44d4-9999-b14ce284b6ff" acquired by "delete_snapshot" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] Acquiring lock "cinder-quobyte-c55960a3-7ed8-459d-9476-eead39a2fcf6" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-quobyte-c55960a3-7ed8-459d-9476-eead39a2fcf6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] Deleting offline snapshot c55960a3-7ed8-459d-9476-eead39a2fcf6 of volume 28abc70a-7e9d-44d4-9999-b14ce284b6ff {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] snapshot_file for this snap is: volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[59544880-6500-45a2-9b9c-5f59110041bc]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:15 devstack sudo[104906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6
Jun 18 11:39:15 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] Acquiring lock "cinder-7cdc57a1-6a00-493c-b5b9-370584dc1009-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-7cdc57a1-6a00-493c-b5b9-370584dc1009-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] Acquiring lock "cinder-quobyte-7cdc57a1-6a00-493c-b5b9-370584dc1009" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-quobyte-7cdc57a1-6a00-493c-b5b9-370584dc1009" acquired by "delete_volume" :: waited 0.028s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89052bb-0f3c-4244-a89b-8c5263bd3b9a]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:15 devstack sudo[104916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009
Jun 18 11:39:15 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:15 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6" returned: 0 in 0.789s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[8656a8bd-4db9-46ff-8b8e-001d280f9582]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:16 devstack sudo[104920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff
Jun 18 11:39:16 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:16 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:16 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b1i2yoo2devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0" returned: 0 in 1.907s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:16 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b1i2yoo2devstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0 {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:39:16 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Converted 112.00 MB image at 58.64 MB/s
Jun 18 11:39:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009" returned: 0 in 0.895s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:16 devstack sudo[104928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0 1G
Jun 18 11:39:16 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:16 devstack sudo[104929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009
Jun 18 11:39:16 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:16 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff" returned: 0 in 0.826s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:16 devstack sudo[104932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6
Jun 18 11:39:16 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:17 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7cdc57a1-6a00-493c-b5b9-370584dc1009" returned: 0 in 0.673s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-quobyte-7cdc57a1-6a00-493c-b5b9-370584dc1009" released by "delete_volume" :: held 1.643s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:17 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0 1G" returned: 0 in 0.725s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec54f090-a16d-407f-9385-8d85b7bc86fa]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] Created reservations ['97d01a42-8cdc-467c-880e-ec0528ffc621', '0b28c0d2-70b8-413f-b0ac-6270ceeef287', 'a08b7116-bb07-478c-97c5-36c31d3414e0', '7d892947-2349-47bc-8054-270f749136e1'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:17 devstack sudo[104941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0
Jun 18 11:39:17 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:17 devstack sudo[104942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:39:17 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:17 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6" returned: 0 in 0.803s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:17 devstack sudo[104945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6
Jun 18 11:39:17 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] Acquiring lock "cinder-7fabf23c-8bd3-4964-879b-ba89e78b9aea-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-7fabf23c-8bd3-4964-879b-ba89e78b9aea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] Acquiring lock "cinder-quobyte-7fabf23c-8bd3-4964-879b-ba89e78b9aea" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-quobyte-7fabf23c-8bd3-4964-879b-ba89e78b9aea" acquired by "delete_volume" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb82b90-e4dd-4bdb-8ccc-466c400d5f15]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:18 devstack sudo[104947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea
Jun 18 11:39:18 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:18 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.697s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:18 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:39:18 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] Deleted volume successfully.
Jun 18 11:39:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b9b67d51-ae6d-4eac-80e5-959ff2928aab tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-7cdc57a1-6a00-493c-b5b9-370584dc1009-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:18 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0" returned: 0 in 0.910s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:18 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff.c55960a3-7ed8-459d-9476-eead39a2fcf6" returned: 0 in 0.761s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-quobyte-c55960a3-7ed8-459d-9476-eead39a2fcf6" released by "_delete_snapshot" :: held 3.295s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-quobyte-28abc70a-7e9d-44d4-9999-b14ce284b6ff" released by "delete_snapshot" :: held 3.321s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:18 devstack sudo[104953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0
Jun 18 11:39:18 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:18 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] Created reservations ['61fa1e74-cb19-4dd6-b897-d558281b3d09', '6add44f5-43df-4d36-990a-016d42ee25be', 'f94abe91-f20d-4528-ad8c-752e6f8d7c4f', '06d618f3-c564-4c70-9015-9ede6a387e78'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:39:18 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] Delete snapshot completed successfully.
Jun 18 11:39:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4e4170b3-54f5-48a4-8ee9-3af4a4a57ae3 tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-c55960a3-7ed8-459d-9476-eead39a2fcf6-delete_snapshot" released by "delete_snapshot" :: held 3.481s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:18 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea" returned: 0 in 0.861s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:18 devstack sudo[104958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea
Jun 18 11:39:18 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:19 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0" returned: 1 in 0.793s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Downloaded image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 ((None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}])) to volume 348054b2-d47c-4bce-8908-6342a4b493a0 successfully. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Temporary image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 for user 88790e9e355946e0b807c986a668f96e is deleted. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Marking volume 348054b2-d47c-4bce-8908-6342a4b493a0 as bootable. {{(pid=91663) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Copying metadata from image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 to 348054b2-d47c-4bce-8908-6342a4b493a0. {{(pid=91663) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Creating volume glance metadata for volume 348054b2-d47c-4bce-8908-6342a4b493a0 backed by image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91663) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60792d57-915b-47e2-b9c4-d28549828c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-348054b2-d47c-4bce-8908-6342a4b493a0', 'volume_size': 1, 'image_id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767e7f9d16154dd1a44a1bc208ee9108', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'created_at': datetime.datetime(2026, 6, 18, 9, 18, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 18, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ff0fa5160>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1147e9e-2f0f-483a-8784-db3133aed5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:19 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Volume volume-348054b2-d47c-4bce-8908-6342a4b493a0 (348054b2-d47c-4bce-8908-6342a4b493a0): created successfully
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1147e9e-2f0f-483a-8784-db3133aed5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Flow 'volume_create_manager' (1a19c07b-7276-4d1b-9dd2-d74364eb5d65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:39:19 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-42865ab1-0038-4827-9762-e657c0d16551 tempest-VolumesGetTest-355417129 None] Created volume successfully.
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] Acquiring lock "cinder-28abc70a-7e9d-44d4-9999-b14ce284b6ff-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-28abc70a-7e9d-44d4-9999-b14ce284b6ff-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] Acquiring lock "cinder-quobyte-28abc70a-7e9d-44d4-9999-b14ce284b6ff" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:19 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-quobyte-28abc70a-7e9d-44d4-9999-b14ce284b6ff" acquired by "delete_volume" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7fabf23c-8bd3-4964-879b-ba89e78b9aea" returned: 0 in 0.710s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-quobyte-7fabf23c-8bd3-4964-879b-ba89e78b9aea" released by "delete_volume" :: held 1.620s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e3c9a0-b8c8-4ada-bce2-6a74da22b8cc]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] Created reservations ['07f86962-4ba9-440d-96f8-25bdfce53464', 'e2e35d01-a921-402e-85c9-97eb63e205dd', 'd3a41eeb-ae79-4f1a-ae39-d5f1bc916b21', '48f1227b-8c00-471e-b25e-f0b455041040'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:39:19 devstack sudo[104964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff
Jun 18 11:39:19 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:19 devstack sudo[104967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:39:19 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Flow 'volume_create_manager' (5aa41870-7896-4a7b-95ec-e33383ac9567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e278ad8-0de5-4375-bd98-1df96c0edc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e278ad8-0de5-4375-bd98-1df96c0edc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:39:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1059683012',display_name='tempest-VolumesGetTest-Volume-281548133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1324ecb-8817-4751-9cb4-a90504d8b5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80229cfc6efc4b7ab553b1225b3eeb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:39:20Z,use_quota=True,user_id='88790e9e355946e0b807c986a668f96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca787e7-efa8-4e36-9765-0b3a3560f734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca787e7-efa8-4e36-9765-0b3a3560f734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28533e5-6407-4605-b644-cc016ae2caa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28533e5-6407-4605-b644-cc016ae2caa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1324ecb-8817-4751-9cb4-a90504d8b5aa', 'volume_name': 'volume-c1324ecb-8817-4751-9cb4-a90504d8b5aa', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f926778-f493-4345-a71b-5f870522d4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f926778-f493-4345-a71b-5f870522d4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45ff5b6-5f77-4bae-8d92-572bbe94ed11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:20 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Volume c1324ecb-8817-4751-9cb4-a90504d8b5aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1324ecb-8817-4751-9cb4-a90504d8b5aa', 'volume_size': 1}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:39:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1059683012',display_name='tempest-VolumesGetTest-Volume-281548133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1324ecb-8817-4751-9cb4-a90504d8b5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80229cfc6efc4b7ab553b1225b3eeb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:39:20Z,use_quota=True,user_id='88790e9e355946e0b807c986a668f96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Creating volume c1324ecb-8817-4751-9cb4-a90504d8b5aa {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:39:20 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c1324ecb-8817-4751-9cb4-a90504d8b5aa 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:20 devstack sudo[104973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c1324ecb-8817-4751-9cb4-a90504d8b5aa 1073741824
Jun 18 11:39:20 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:20 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff" returned: 0 in 0.888s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:20 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:20 devstack sudo[104975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff
Jun 18 11:39:20 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.782s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:39:20 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] Deleted volume successfully.
Jun 18 11:39:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-ebe83be9-1de9-4d2e-95f7-48b8fcadc9ac tempest-VolumeDependencyTests-1428559713 None] Lock "cinder-7fabf23c-8bd3-4964-879b-ba89e78b9aea-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:21 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-28abc70a-7e9d-44d4-9999-b14ce284b6ff" returned: 0 in 0.921s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-quobyte-28abc70a-7e9d-44d4-9999-b14ce284b6ff" released by "delete_volume" :: held 1.892s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:21 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c1324ecb-8817-4751-9cb4-a90504d8b5aa 1073741824" returned: 0 in 1.050s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:21 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] Created reservations ['275a3ad0-a695-4758-a39a-88f2a74244d7', 'ee862998-86c5-4530-91b1-51f8eaec62e5', '18da5b2e-20aa-4e64-a58f-148030162115', '6d20e208-1ed9-46fa-97ca-39a9d1fd3ba0'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:39:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c1324ecb-8817-4751-9cb4-a90504d8b5aa {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:21 devstack sudo[105019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c1324ecb-8817-4751-9cb4-a90504d8b5aa
Jun 18 11:39:21 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:39:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:39:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:21 devstack sudo[105021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:39:21 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:22 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c1324ecb-8817-4751-9cb4-a90504d8b5aa" returned: 0 in 0.821s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:39:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:22 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45ff5b6-5f77-4bae-8d92-572bbe94ed11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1324ecb-8817-4751-9cb4-a90504d8b5aa', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:22 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:22 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3d651c-16f8-4af6-b7ef-139986e4d6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.779s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:22 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:39:22 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] Deleted volume successfully.
Jun 18 11:39:22 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Volume volume-c1324ecb-8817-4751-9cb4-a90504d8b5aa (c1324ecb-8817-4751-9cb4-a90504d8b5aa): created successfully
Jun 18 11:39:22 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3d651c-16f8-4af6-b7ef-139986e4d6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:22 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Flow 'volume_create_manager' (5aa41870-7896-4a7b-95ec-e33383ac9567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:39:22 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-995c35a3-fea6-4b62-b953-dc860e121581 tempest-VolumesGetTest-355417129 None] Created volume successfully.
Jun 18 11:39:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2a7c165f-8a6c-4868-8aef-1780f3464d6d tempest-VolumesSnapshotListTestJSON-891834788 None] Lock "cinder-28abc70a-7e9d-44d4-9999-b14ce284b6ff-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] Acquiring lock "cinder-c1324ecb-8817-4751-9cb4-a90504d8b5aa-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] Lock "cinder-c1324ecb-8817-4751-9cb4-a90504d8b5aa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] Acquiring lock "cinder-quobyte-c1324ecb-8817-4751-9cb4-a90504d8b5aa" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-c1324ecb-8817-4751-9cb4-a90504d8b5aa" acquired by "delete_volume" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:23 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5ed9fd-a369-491a-bccf-18c8c7c01f8a]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c1324ecb-8817-4751-9cb4-a90504d8b5aa {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:23 devstack sudo[105025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c1324ecb-8817-4751-9cb4-a90504d8b5aa
Jun 18 11:39:23 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:24 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c1324ecb-8817-4751-9cb4-a90504d8b5aa" returned: 0 in 0.864s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c1324ecb-8817-4751-9cb4-a90504d8b5aa {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:24 devstack sudo[105030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c1324ecb-8817-4751-9cb4-a90504d8b5aa
Jun 18 11:39:24 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:24 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Flow 'volume_create_manager' (4c6f14a1-6e64-43ec-ae30-ff83c054e8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4ce492-1374-4a78-9af2-3b04631b0fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4ce492-1374-4a78-9af2-3b04631b0fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-768421149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8461db-7d55-48f2-9ff4-f3a06dac33ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f228b1dad25c4ddc830407d852c9fa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:39:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:39:25Z,use_quota=True,user_id='00501355fa8644d19b8cb444c9669ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf19cd73-4224-41cb-b0b4-d5fa2e022ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf19cd73-4224-41cb-b0b4-d5fa2e022ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5965d36-5785-459a-bc4c-de6e78f05f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5965d36-5785-459a-bc4c-de6e78f05f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a8461db-7d55-48f2-9ff4-f3a06dac33ae', 'volume_name': 'volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae', 'volume_size': 2}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7475df9f-fefa-4701-b871-f14c0b37c023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7475df9f-fefa-4701-b871-f14c0b37c023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f5eab7-c98f-4338-8451-8fa1fbb2d831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:25 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Volume 7a8461db-7d55-48f2-9ff4-f3a06dac33ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae', 'volume_size': 2}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-768421149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8461db-7d55-48f2-9ff4-f3a06dac33ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f228b1dad25c4ddc830407d852c9fa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:39:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:39:25Z,use_quota=True,user_id='00501355fa8644d19b8cb444c9669ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Creating volume 7a8461db-7d55-48f2-9ff4-f3a06dac33ae {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:39:25 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae 2147483648 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:25 devstack sudo[105032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae 2147483648
Jun 18 11:39:25 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:25 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c1324ecb-8817-4751-9cb4-a90504d8b5aa" returned: 0 in 0.751s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-c1324ecb-8817-4751-9cb4-a90504d8b5aa" released by "delete_volume" :: held 1.664s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:25 devstack sudo[105035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:39:25 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] Created reservations ['4030dc17-1d36-421b-95b4-17448ac452ee', '407e4314-04bb-422b-92c9-1991c774943b', '06a65b80-ba7e-430b-9dd0-70b51b381ce3', '6372244c-f743-424c-a0fb-9943502c22dd'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:25 devstack sudo[105037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:39:25 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Acquiring lock "cinder-348054b2-d47c-4bce-8908-6342a4b493a0-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Lock "cinder-348054b2-d47c-4bce-8908-6342a4b493a0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:26 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae 2147483648" returned: 0 in 1.072s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Acquiring lock "cinder-quobyte-348054b2-d47c-4bce-8908-6342a4b493a0" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:26 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.739s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:39:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-348054b2-d47c-4bce-8908-6342a4b493a0" acquired by "delete_volume" :: waited 0.030s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:39:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:39:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:39:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:26 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[be835007-738f-4ebb-b61e-a294214df541]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:26 devstack sudo[105045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae
Jun 18 11:39:26 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:26 devstack sudo[105047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0
Jun 18 11:39:26 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:26 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.935s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:39:26 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] Deleted volume successfully.
Jun 18 11:39:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-aec44bfa-78ed-46b9-8e0b-a9ed49c365a7 tempest-VolumesGetTest-355417129 None] Lock "cinder-c1324ecb-8817-4751-9cb4-a90504d8b5aa-delete_volume" released by "delete_volume" :: held 2.906s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:27 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae" returned: 0 in 0.800s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:27 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:39:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f5eab7-c98f-4338-8451-8fa1fbb2d831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae', 'volume_size': 2}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aeba67c-b9ba-4307-8f5d-e537b480ce74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:27 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Volume volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae (7a8461db-7d55-48f2-9ff4-f3a06dac33ae): created successfully
Jun 18 11:39:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aeba67c-b9ba-4307-8f5d-e537b480ce74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:27 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Flow 'volume_create_manager' (4c6f14a1-6e64-43ec-ae30-ff83c054e8dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:39:27 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-6cfdf6c1-c32f-4cf6-9b64-626b2d202a75 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Created volume successfully.
Jun 18 11:39:27 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0" returned: 0 in 0.864s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:27 devstack sudo[105053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0
Jun 18 11:39:27 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:27 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0" returned: 1 in 0.874s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:39:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:28 devstack sudo[105058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0
Jun 18 11:39:28 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Creating offline snapshot b769f770-c4b6-40bf-add4-e72a1a82c1ba of volume 7a8461db-7d55-48f2-9ff4-f3a06dac33ae {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:39:28 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[402ee294-b613-4ce4-a062-ac904a2a816f]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:28 devstack sudo[105060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae
Jun 18 11:39:28 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:28 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-348054b2-d47c-4bce-8908-6342a4b493a0" returned: 0 in 0.764s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:28 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Lock "cinder-quobyte-348054b2-d47c-4bce-8908-6342a4b493a0" released by "delete_volume" :: held 2.594s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:28 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Created reservations ['7eadbd24-9a4e-46ee-b87d-91c61e802005', '207c80f7-2560-4740-8f36-cfc7649fb8de', '5909f839-b199-4118-a85e-fe4e06a84408', 'cfb9fe92-ef74-4448-9e09-7eeabf35c568'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:39:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:39:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:39:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:29 devstack sudo[105063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:39:29 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:29 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae" returned: 0 in 1.218s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba 2G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:29 devstack sudo[105070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba 2G
Jun 18 11:39:29 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:29 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.888s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:29 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:39:29 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Deleted volume successfully.
Jun 18 11:39:29 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9bdf0d1-718c-4c39-9deb-66367323ed57 tempest-VolumesGetTest-355417129 None] Lock "cinder-348054b2-d47c-4bce-8908-6342a4b493a0-delete_volume" released by "delete_volume" :: held 3.793s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:30 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba 2G" returned: 0 in 0.962s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:30 devstack sudo[105076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba
Jun 18 11:39:30 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:31 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba" returned: 0 in 0.863s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:31 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba is being set with open permissions: ugo+rw
Jun 18 11:39:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:31 devstack sudo[105081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba
Jun 18 11:39:31 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:32 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba" returned: 0 in 0.680s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:32 devstack sudo[105084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.info
Jun 18 11:39:32 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:32 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:39:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Flow 'volume_create_manager' (465fcb83-3ef1-45f1-b6f7-ebb5839b5225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:39:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8140fe2-9a16-40e4-a2df-46674b6a706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8140fe2-9a16-40e4-a2df-46674b6a706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1139069136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8131ee-c21c-4ec3-90f9-cd2be286cf89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc96ef8a29ae42d3b8ca7dddbe6bcd2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:39:33Z,use_quota=True,user_id='50b77609605849f88ae35c7b3537c0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33059419-297b-447f-9fda-8032542dfc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33059419-297b-447f-9fda-8032542dfc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ca95e1-d309-4680-8cfd-b4e07b0296b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ca95e1-d309-4680-8cfd-b4e07b0296b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff8131ee-c21c-4ec3-90f9-cd2be286cf89', 'volume_name': 'volume-ff8131ee-c21c-4ec3-90f9-cd2be286cf89', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed2c613-ab89-4605-9b40-9edcd5b61c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed2c613-ab89-4605-9b40-9edcd5b61c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3b1754-33d3-478b-aa83-b0a4f33e4230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:33 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Volume ff8131ee-c21c-4ec3-90f9-cd2be286cf89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff8131ee-c21c-4ec3-90f9-cd2be286cf89', 'volume_size': 1}
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:33 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.info" returned: 0 in 0.807s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:33 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.info is being set with open permissions: ugo+rw
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:33 devstack sudo[105087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.info
Jun 18 11:39:33 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:33 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.info" returned: 0 in 0.653s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.322s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.808s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1139069136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8131ee-c21c-4ec3-90f9-cd2be286cf89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc96ef8a29ae42d3b8ca7dddbe6bcd2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:39:33Z,use_quota=True,user_id='50b77609605849f88ae35c7b3537c0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Creating volume ff8131ee-c21c-4ec3-90f9-cd2be286cf89 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:39:33 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:39:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ff8131ee-c21c-4ec3-90f9-cd2be286cf89 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:33 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-604d74fb-0832-476f-90d7-0224329d5dfb tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Create snapshot completed successfully
Jun 18 11:39:33 devstack sudo[105090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ff8131ee-c21c-4ec3-90f9-cd2be286cf89 1073741824
Jun 18 11:39:33 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:34 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ff8131ee-c21c-4ec3-90f9-cd2be286cf89 1073741824" returned: 0 in 0.916s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ff8131ee-c21c-4ec3-90f9-cd2be286cf89 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:34 devstack sudo[105095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ff8131ee-c21c-4ec3-90f9-cd2be286cf89
Jun 18 11:39:34 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Acquiring lock "cinder-b769f770-c4b6-40bf-add4-e72a1a82c1ba-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "cinder-b769f770-c4b6-40bf-add4-e72a1a82c1ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Acquiring lock "cinder-quobyte-7a8461db-7d55-48f2-9ff4-f3a06dac33ae" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "cinder-quobyte-7a8461db-7d55-48f2-9ff4-f3a06dac33ae" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Acquiring lock "cinder-quobyte-b769f770-c4b6-40bf-add4-e72a1a82c1ba" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "cinder-quobyte-b769f770-c4b6-40bf-add4-e72a1a82c1ba" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:34 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Deleting offline snapshot b769f770-c4b6-40bf-add4-e72a1a82c1ba of volume 7a8461db-7d55-48f2-9ff4-f3a06dac33ae {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:39:34 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] snapshot_file for this snap is: volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:39:35 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b86acb-8832-465a-8e23-d795f07aa2dd]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:35 devstack sudo[105097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba
Jun 18 11:39:35 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:35 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ff8131ee-c21c-4ec3-90f9-cd2be286cf89" returned: 0 in 0.728s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:35 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:39:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3b1754-33d3-478b-aa83-b0a4f33e4230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff8131ee-c21c-4ec3-90f9-cd2be286cf89', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d690de65-5876-4ba9-b47b-d1cf2628ef2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:35 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Volume volume-ff8131ee-c21c-4ec3-90f9-cd2be286cf89 (ff8131ee-c21c-4ec3-90f9-cd2be286cf89): created successfully
Jun 18 11:39:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d690de65-5876-4ba9-b47b-d1cf2628ef2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:35 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Flow 'volume_create_manager' (465fcb83-3ef1-45f1-b6f7-ebb5839b5225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:39:35 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-5c85263e-3229-4c26-9f0b-724ab41e1c03 tempest-VolumesNegativeTest-1970148999 None] Created volume successfully.
Jun 18 11:39:35 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba" returned: 0 in 0.806s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:35 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:39:35 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[59591970-28dd-4581-9c80-7fdea0fe6aec]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:35 devstack sudo[105103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae
Jun 18 11:39:35 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:36 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae" returned: 0 in 0.836s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:36 devstack sudo[105109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba
Jun 18 11:39:36 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:37 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba" returned: 0 in 0.943s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:37 devstack sudo[105118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba
Jun 18 11:39:37 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:38 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae.b769f770-c4b6-40bf-add4-e72a1a82c1ba" returned: 0 in 0.666s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "cinder-quobyte-b769f770-c4b6-40bf-add4-e72a1a82c1ba" released by "_delete_snapshot" :: held 3.380s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "cinder-quobyte-7a8461db-7d55-48f2-9ff4-f3a06dac33ae" released by "delete_snapshot" :: held 3.406s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:38 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Created reservations ['924fe968-dbdb-48f2-86af-05a7d0ff5a69', 'f32d9c18-80f2-477a-9c23-eb04ca958b14', 'df4f8548-e835-4d39-b738-4d0024316b09', '234da24e-7725-4cb1-b566-867fe4a4ed57'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:39:38 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Delete snapshot completed successfully.
Jun 18 11:39:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e9841f6-9ef9-4511-a0bb-719cd3eca4f8 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "cinder-b769f770-c4b6-40bf-add4-e72a1a82c1ba-delete_snapshot" released by "delete_snapshot" :: held 3.586s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:39 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Acquiring lock "cinder-7a8461db-7d55-48f2-9ff4-f3a06dac33ae-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:39 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "cinder-7a8461db-7d55-48f2-9ff4-f3a06dac33ae-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:39 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Acquiring lock "cinder-quobyte-7a8461db-7d55-48f2-9ff4-f3a06dac33ae" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:39 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "cinder-quobyte-7a8461db-7d55-48f2-9ff4-f3a06dac33ae" acquired by "delete_volume" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:39 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a896b9-ea32-4af2-8c22-df65e7615cfa]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:39 devstack sudo[105121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae
Jun 18 11:39:39 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:40 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae" returned: 0 in 0.804s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:40 devstack sudo[105127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae
Jun 18 11:39:40 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:40 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7a8461db-7d55-48f2-9ff4-f3a06dac33ae" returned: 0 in 0.655s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:40 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "cinder-quobyte-7a8461db-7d55-48f2-9ff4-f3a06dac33ae" released by "delete_volume" :: held 1.547s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:40 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Created reservations ['bcca8489-4076-4a4d-b3ea-05fe3e4c752e', 'be835d56-78da-4b38-bab9-926f1351f962', 'aa4507d4-8bed-40c8-99ca-e082c4b198c3', 'c4760ee4-880e-4f4b-90c3-077a40c1f4b1'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:39:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:39:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:39:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:41 devstack sudo[105130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:39:41 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:41 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.801s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:41 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:39:41 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Deleted volume successfully.
Jun 18 11:39:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-820fb726-026d-4776-96be-09fc34b4bd07 tempest-VolumesSnapshotNegativeTestJSON-553716170 None] Lock "cinder-7a8461db-7d55-48f2-9ff4-f3a06dac33ae-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:UPDATE=128,cinder:SELECT=91,cinder:DELETE=16,cinder:INSERT=47 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:UPDATE=132,cinder:SELECT=126,cinder:INSERT=32,cinder:DELETE=6 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Flow 'volume_create_manager' (a1c05add-b025-4bda-bd21-bdf828dbd9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc57799-517a-4f5c-9caf-677ecb630327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc57799-517a-4f5c-9caf-677ecb630327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-307784407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce57e2f-4fe6-4b4c-b93d-19a140009952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eafc2aa372e42058386121e7c0a7d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:39:47Z,use_quota=True,user_id='661bb76a1caf45a882f59c8083ce906f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a99a892-a202-4265-aee1-31d951bcb312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a99a892-a202-4265-aee1-31d951bcb312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6e5fba-284e-4143-b1be-c14f0fc7d0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6e5fba-284e-4143-b1be-c14f0fc7d0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ce57e2f-4fe6-4b4c-b93d-19a140009952', 'volume_name': 'volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06a274b-438e-496f-a72e-a85f6a098427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06a274b-438e-496f-a72e-a85f6a098427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779e5424-5b03-472b-b5cc-896d9ee1a21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:47 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Volume 5ce57e2f-4fe6-4b4c-b93d-19a140009952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952', 'volume_size': 1}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-307784407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce57e2f-4fe6-4b4c-b93d-19a140009952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eafc2aa372e42058386121e7c0a7d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:39:47Z,use_quota=True,user_id='661bb76a1caf45a882f59c8083ce906f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Creating volume 5ce57e2f-4fe6-4b4c-b93d-19a140009952 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:39:47 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:39:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:47 devstack sudo[105149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 1073741824
Jun 18 11:39:47 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:48 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 1073741824" returned: 0 in 1.046s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:48 devstack sudo[105157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952
Jun 18 11:39:48 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:49 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952" returned: 0 in 0.759s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:49 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:39:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779e5424-5b03-472b-b5cc-896d9ee1a21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed76353-0567-4d48-b0e5-ed1ac8593802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:49 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Volume volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 (5ce57e2f-4fe6-4b4c-b93d-19a140009952): created successfully
Jun 18 11:39:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed76353-0567-4d48-b0e5-ed1ac8593802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:49 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Flow 'volume_create_manager' (a1c05add-b025-4bda-bd21-bdf828dbd9d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:39:49 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d96dfcdf-2435-47f1-ab76-1f4548747e88 tempest-SnapshotDependencyTests-1533965241 None] Created volume successfully.
Jun 18 11:39:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] Creating offline snapshot 79093ad6-80d7-44f2-b35c-bff258e6c4ed of volume 5ce57e2f-4fe6-4b4c-b93d-19a140009952 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:39:50 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c2b819-662b-4ce5-8f5e-7c2a882965a4]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:50 devstack sudo[105161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952
Jun 18 11:39:50 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:51 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952" returned: 0 in 0.907s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:51 devstack sudo[105169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed 1G
Jun 18 11:39:51 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:52 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed 1G" returned: 0 in 1.160s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:52 devstack sudo[105199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed
Jun 18 11:39:52 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:54 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed" returned: 0 in 1.417s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:54 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed is being set with open permissions: ugo+rw
Jun 18 11:39:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:54 devstack sudo[105247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed
Jun 18 11:39:54 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:55 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed" returned: 0 in 1.223s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:55 devstack sudo[105251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.info
Jun 18 11:39:55 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:56 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.info" returned: 0 in 0.784s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:56 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.info is being set with open permissions: ugo+rw
Jun 18 11:39:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:56 devstack sudo[105254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.info
Jun 18 11:39:56 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:39:57 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root
Jun 18 11:39:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.info" returned: 0 in 1.070s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:39:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.723s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:57 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-f144b512-269a-4ebc-81bf-907bdab3d3fc tempest-SnapshotDependencyTests-1533965241 None] Create snapshot completed successfully
Jun 18 11:39:58 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:39:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Flow 'volume_create_manager' (c378b3df-e2cb-4297-9f7f-a3432956f02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:39:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392241ba-679e-4a94-ae14-eb15e5ecb3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392241ba-679e-4a94-ae14-eb15e5ecb3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c180fb42-33c1-4568-9b1e-9eeb5d526317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eafc2aa372e42058386121e7c0a7d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=79093ad6-80d7-44f2-b35c-bff258e6c4ed,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:39:59Z,use_quota=True,user_id='661bb76a1caf45a882f59c8083ce906f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74636268-d678-4e04-b732-bdd8a9312ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74636268-d678-4e04-b732-bdd8a9312ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7fcbcb1-d5bb-4dff-978e-a7921432084e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7fcbcb1-d5bb-4dff-978e-a7921432084e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c180fb42-33c1-4568-9b1e-9eeb5d526317', 'volume_name': 'volume-c180fb42-33c1-4568-9b1e-9eeb5d526317', 'volume_size': 1, 'snapshot_id': '79093ad6-80d7-44f2-b35c-bff258e6c4ed'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe881763-1166-41b2-b615-d8c32d4170ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe881763-1166-41b2-b615-d8c32d4170ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8d21be-9743-4fe3-9a9d-3744b719ecc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:39:59 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Volume c180fb42-33c1-4568-9b1e-9eeb5d526317: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c180fb42-33c1-4568-9b1e-9eeb5d526317', 'volume_size': 1, 'snapshot_id': '79093ad6-80d7-44f2-b35c-bff258e6c4ed'}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Acquiring lock "cinder-quobyte-79093ad6-80d7-44f2-b35c-bff258e6c4ed-c180fb42-33c1-4568-9b1e-9eeb5d526317" by "_create_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-quobyte-79093ad6-80d7-44f2-b35c-bff258e6c4ed-c180fb42-33c1-4568-9b1e-9eeb5d526317" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Creating volume c180fb42-33c1-4568-9b1e-9eeb5d526317 from snapshot 79093ad6-80d7-44f2-b35c-bff258e6c4ed {{(pid=91663) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Acquiring lock "cinder-quobyte-c180fb42-33c1-4568-9b1e-9eeb5d526317" by "_copy_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-quobyte-c180fb42-33c1-4568-9b1e-9eeb5d526317" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] snapshot: 79093ad6-80d7-44f2-b35c-bff258e6c4ed, volume: c180fb42-33c1-4568-9b1e-9eeb5d526317,  {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6610c2-c769-4345-a99c-c3947bd46d72]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:39:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:39:59 devstack sudo[105297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed
Jun 18 11:39:59 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:00 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed" returned: 0 in 0.924s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:40:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 18 11:40:00 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Creating direct copy from snapshot {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 18 11:40:00 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3457fc-29f7-45f5-a367-b90913001d6d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:40:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:00 devstack sudo[105306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952
Jun 18 11:40:00 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:00 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952" returned: 0 in 0.844s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:00 devstack cinder-volume[91663]: DEBUG cinder.utils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Path /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c180fb42-33c1-4568-9b1e-9eeb5d526317 not found in is_blk_device check {{(pid=91663) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 18 11:40:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c180fb42-33c1-4568-9b1e-9eeb5d526317 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:00 devstack sudo[105313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c180fb42-33c1-4568-9b1e-9eeb5d526317
Jun 18 11:40:00 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:06 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c180fb42-33c1-4568-9b1e-9eeb5d526317" returned: 0 in 5.684s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:06 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f697e9-db35-455f-b6c4-a5a12fc6411a]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:40:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:06 devstack sudo[105335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952
Jun 18 11:40:06 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:07 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952" returned: 0 in 1.139s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:07 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c180fb42-33c1-4568-9b1e-9eeb5d526317 {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:40:07 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Converted 1024.00 MB image at 180.12 MB/s
Jun 18 11:40:07 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c180fb42-33c1-4568-9b1e-9eeb5d526317 is being set with open permissions: ugo+rw
Jun 18 11:40:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c180fb42-33c1-4568-9b1e-9eeb5d526317 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:07 devstack sudo[105340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c180fb42-33c1-4568-9b1e-9eeb5d526317
Jun 18 11:40:07 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:08 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c180fb42-33c1-4568-9b1e-9eeb5d526317" returned: 0 in 0.737s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:08 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-quobyte-c180fb42-33c1-4568-9b1e-9eeb5d526317" released by "_copy_volume_from_snapshot" :: held 9.429s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:40:08 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-quobyte-79093ad6-80d7-44f2-b35c-bff258e6c4ed-c180fb42-33c1-4568-9b1e-9eeb5d526317" released by "_create_volume_from_snapshot" :: held 9.458s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:40:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.477s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:40:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8d21be-9743-4fe3-9a9d-3744b719ecc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c180fb42-33c1-4568-9b1e-9eeb5d526317', 'volume_size': 1, 'snapshot_id': '79093ad6-80d7-44f2-b35c-bff258e6c4ed'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f129dd11-f515-4c43-afe2-8bb9a5c59619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:08 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Volume volume-c180fb42-33c1-4568-9b1e-9eeb5d526317 (c180fb42-33c1-4568-9b1e-9eeb5d526317): created successfully
Jun 18 11:40:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f129dd11-f515-4c43-afe2-8bb9a5c59619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Flow 'volume_create_manager' (c378b3df-e2cb-4297-9f7f-a3432956f02c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:40:08 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-fcb002d9-3d22-4397-920d-9bedfc8d1b3b tempest-SnapshotDependencyTests-1533965241 None] Created volume successfully.
Jun 18 11:40:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] Acquiring lock "cinder-79093ad6-80d7-44f2-b35c-bff258e6c4ed-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:40:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-79093ad6-80d7-44f2-b35c-bff258e6c4ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:40:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] Acquiring lock "cinder-quobyte-5ce57e2f-4fe6-4b4c-b93d-19a140009952" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:40:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-quobyte-5ce57e2f-4fe6-4b4c-b93d-19a140009952" acquired by "delete_snapshot" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:40:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] Acquiring lock "cinder-quobyte-79093ad6-80d7-44f2-b35c-bff258e6c4ed" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:40:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-quobyte-79093ad6-80d7-44f2-b35c-bff258e6c4ed" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:40:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] Deleting offline snapshot 79093ad6-80d7-44f2-b35c-bff258e6c4ed of volume 5ce57e2f-4fe6-4b4c-b93d-19a140009952 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:40:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] snapshot_file for this snap is: volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:40:09 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6801c9-655f-45e3-8173-57799cfb2f9e]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:40:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:09 devstack sudo[105344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed
Jun 18 11:40:09 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:09 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed" returned: 0 in 0.868s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:40:10 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e583d9-55f3-4cca-bcfb-d9c827b0c859]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:40:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:10 devstack sudo[105352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952
Jun 18 11:40:10 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:10 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952" returned: 0 in 0.828s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:10 devstack sudo[105357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed
Jun 18 11:40:10 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:11 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed" returned: 0 in 0.864s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:11 devstack sudo[105362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed
Jun 18 11:40:11 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:12 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952.79093ad6-80d7-44f2-b35c-bff258e6c4ed" returned: 0 in 0.751s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-quobyte-79093ad6-80d7-44f2-b35c-bff258e6c4ed" released by "_delete_snapshot" :: held 3.445s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:40:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-quobyte-5ce57e2f-4fe6-4b4c-b93d-19a140009952" released by "delete_snapshot" :: held 3.472s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:40:12 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] Created reservations ['41ac6652-b39d-43db-8992-5ee9aa6ebaaa', '019b1330-c6fa-41c8-b95f-f5a315830962', '9e620c75-e268-49f0-9738-053f2d657c23', '78a551aa-2450-4671-a582-0dc32f43c087'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:40:12 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] Delete snapshot completed successfully.
Jun 18 11:40:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-212beb92-023a-43ae-aef1-87356e102e66 tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-79093ad6-80d7-44f2-b35c-bff258e6c4ed-delete_snapshot" released by "delete_snapshot" :: held 3.641s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:40:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] Acquiring lock "cinder-5ce57e2f-4fe6-4b4c-b93d-19a140009952-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:40:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-5ce57e2f-4fe6-4b4c-b93d-19a140009952-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:40:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] Acquiring lock "cinder-quobyte-5ce57e2f-4fe6-4b4c-b93d-19a140009952" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:40:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-quobyte-5ce57e2f-4fe6-4b4c-b93d-19a140009952" acquired by "delete_volume" :: waited 0.026s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:40:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] Acquiring lock "cinder-ff8131ee-c21c-4ec3-90f9-cd2be286cf89-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:40:13 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad490437-c115-4b26-8f37-b8f11370d904]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:40:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] Lock "cinder-ff8131ee-c21c-4ec3-90f9-cd2be286cf89-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:40:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] Acquiring lock "cinder-quobyte-ff8131ee-c21c-4ec3-90f9-cd2be286cf89" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:40:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] Lock "cinder-quobyte-ff8131ee-c21c-4ec3-90f9-cd2be286cf89" acquired by "delete_volume" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:40:13 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d468ba5-963b-4adc-8f1f-1462b29703c6]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:40:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ff8131ee-c21c-4ec3-90f9-cd2be286cf89 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:13 devstack sudo[105365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952
Jun 18 11:40:13 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:13 devstack sudo[105366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ff8131ee-c21c-4ec3-90f9-cd2be286cf89
Jun 18 11:40:13 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:14 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952" returned: 0 in 0.809s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:14 devstack sudo[105376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952
Jun 18 11:40:14 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:14 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ff8131ee-c21c-4ec3-90f9-cd2be286cf89" returned: 0 in 0.776s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ff8131ee-c21c-4ec3-90f9-cd2be286cf89 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:14 devstack sudo[105378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ff8131ee-c21c-4ec3-90f9-cd2be286cf89
Jun 18 11:40:14 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:14 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5ce57e2f-4fe6-4b4c-b93d-19a140009952" returned: 0 in 0.680s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-quobyte-5ce57e2f-4fe6-4b4c-b93d-19a140009952" released by "delete_volume" :: held 1.584s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] Created reservations ['17b30e8a-557a-43e2-8a0e-5b96fe5d9f63', '26b9c2c5-6c5a-4609-8d97-d37e22d6d41a', '5ab852a0-7989-4231-84ae-878b683a78f4', '4963e265-8618-4077-81ec-947d8f7074df'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:40:15 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ff8131ee-c21c-4ec3-90f9-cd2be286cf89" returned: 0 in 0.703s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] Lock "cinder-quobyte-ff8131ee-c21c-4ec3-90f9-cd2be286cf89" released by "delete_volume" :: held 1.522s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] Created reservations ['318362a7-0a85-47ff-ba75-f428887bf0a9', 'c46658ee-01bf-4465-bd42-7aad1d9cea8e', 'e342fb30-07e2-4843-954b-ec6ad5bf5cb1', '00edde2f-500b-48d1-8aab-28a4025df55f'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:40:15 devstack sudo[105382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:40:15 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:15 devstack sudo[105387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:40:15 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] Acquiring lock "cinder-c180fb42-33c1-4568-9b1e-9eeb5d526317-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-c180fb42-33c1-4568-9b1e-9eeb5d526317-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] Acquiring lock "cinder-quobyte-c180fb42-33c1-4568-9b1e-9eeb5d526317" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-quobyte-c180fb42-33c1-4568-9b1e-9eeb5d526317" acquired by "delete_volume" :: waited 0.028s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3253f3-509e-43d4-9e7c-80bc01e3ff14]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c180fb42-33c1-4568-9b1e-9eeb5d526317 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:15 devstack sudo[105389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c180fb42-33c1-4568-9b1e-9eeb5d526317
Jun 18 11:40:15 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:15 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.811s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:15 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:40:15 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] Deleted volume successfully.
Jun 18 11:40:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e21bdcb7-07c6-4ee1-8022-b433f4e6686b tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-5ce57e2f-4fe6-4b4c-b93d-19a140009952-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:40:16 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.817s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:16 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:40:16 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] Deleted volume successfully.
Jun 18 11:40:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9d58ce4a-63d7-4a76-9a40-acff18c21ac5 tempest-VolumesNegativeTest-1970148999 None] Lock "cinder-ff8131ee-c21c-4ec3-90f9-cd2be286cf89-delete_volume" released by "delete_volume" :: held 2.623s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:40:16 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c180fb42-33c1-4568-9b1e-9eeb5d526317" returned: 0 in 0.868s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c180fb42-33c1-4568-9b1e-9eeb5d526317 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:16 devstack sudo[105396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c180fb42-33c1-4568-9b1e-9eeb5d526317
Jun 18 11:40:16 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:17 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c180fb42-33c1-4568-9b1e-9eeb5d526317" returned: 0 in 0.744s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-quobyte-c180fb42-33c1-4568-9b1e-9eeb5d526317" released by "delete_volume" :: held 1.669s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:40:17 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] Created reservations ['0d436b48-9bc5-4dae-bc5a-49983cdb231e', '3960f18d-a0e3-4eb6-9425-2c008f94e5f9', '19655d0d-b3ae-4a8c-bd6e-7ea3308f662f', 'eb0c252a-7397-4f05-8bff-9000dcfda046'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:40:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:40:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:40:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:40:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:40:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:40:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:17 devstack sudo[105399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:40:17 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:18 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.677s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:18 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:40:18 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] Deleted volume successfully.
Jun 18 11:40:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1101ec8b-92be-4b61-bec5-9d5c7f95781a tempest-SnapshotDependencyTests-1533965241 None] Lock "cinder-c180fb42-33c1-4568-9b1e-9eeb5d526317-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:40:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:40:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:40:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:40:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:40:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:40:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:40:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:25 devstack sudo[105462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:40:25 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:26 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.725s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:40:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:40:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:40:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:40:27 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=29,cinder:UPDATE=38,cinder:INSERT=9,cinder:DELETE=3 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:40:28 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:UPDATE=33,cinder:SELECT=27,cinder:DELETE=3,cinder:INSERT=9 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Flow 'volume_create_manager' (b617e676-b2cb-4b2b-8335-d89a0658f759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50bbd1c9-dc0f-48fa-8b24-6ee8f196a332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50bbd1c9-dc0f-48fa-8b24-6ee8f196a332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-819106156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99f6a32-00d3-4268-8447-0fdbe9dff028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc83e1b6ed354693a682f3d328cf6694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:40:45Z,use_quota=True,user_id='28d981e8fbf14879bc23152c33cf22a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a130af-fd41-48d1-96cf-7762ae1ec8ef),volume_type_id=c7a130af-fd41-48d1-96cf-7762ae1ec8ef)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b16b86-017d-45c8-9b05-abb968add5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b16b86-017d-45c8-9b05-abb968add5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b40b15f-ab34-48ea-bfae-910e6b45e305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b40b15f-ab34-48ea-bfae-910e6b45e305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c99f6a32-00d3-4268-8447-0fdbe9dff028', 'volume_name': 'volume-c99f6a32-00d3-4268-8447-0fdbe9dff028', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48bb0b8-ddbe-4c58-a1fb-cad2d6790408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48bb0b8-ddbe-4c58-a1fb-cad2d6790408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6582ac4d-6fb9-4321-b607-66e82aa395cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:44 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Volume c99f6a32-00d3-4268-8447-0fdbe9dff028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c99f6a32-00d3-4268-8447-0fdbe9dff028', 'volume_size': 1}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-819106156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99f6a32-00d3-4268-8447-0fdbe9dff028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc83e1b6ed354693a682f3d328cf6694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:40:45Z,use_quota=True,user_id='28d981e8fbf14879bc23152c33cf22a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7a130af-fd41-48d1-96cf-7762ae1ec8ef),volume_type_id=c7a130af-fd41-48d1-96cf-7762ae1ec8ef)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Creating volume c99f6a32-00d3-4268-8447-0fdbe9dff028 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:40:44 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:40:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c99f6a32-00d3-4268-8447-0fdbe9dff028 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:44 devstack sudo[105542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c99f6a32-00d3-4268-8447-0fdbe9dff028 1073741824
Jun 18 11:40:44 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Flow 'volume_create_manager' (7e668a99-4231-4098-b4ee-a1fbf20ae014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5015332f-a569-4cae-b60f-915600704ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5015332f-a569-4cae-b60f-915600704ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-348377900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9412977a-598b-4f67-90c9-398de31b48ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc83e1b6ed354693a682f3d328cf6694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:40:45Z,use_quota=True,user_id='28d981e8fbf14879bc23152c33cf22a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cebb199-e1af-4e4e-89dc-f4ad8fa6404b),volume_type_id=2cebb199-e1af-4e4e-89dc-f4ad8fa6404b)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2855b7d7-4686-4298-9705-ef71c76397c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2855b7d7-4686-4298-9705-ef71c76397c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376240c6-603c-4ad8-97df-0127f0cddea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376240c6-603c-4ad8-97df-0127f0cddea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9412977a-598b-4f67-90c9-398de31b48ff', 'volume_name': 'volume-9412977a-598b-4f67-90c9-398de31b48ff', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4828979-5487-4678-9ac2-a361ad69173d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4828979-5487-4678-9ac2-a361ad69173d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14142766-9a06-4806-b1fa-ef35fcfd7e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:45 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Volume 9412977a-598b-4f67-90c9-398de31b48ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9412977a-598b-4f67-90c9-398de31b48ff', 'volume_size': 1}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Flow 'volume_create_manager' (f48e969d-bb43-4581-90cb-9887ba23b2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632e4f9a-db18-4512-a3c6-2e61a2c53a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632e4f9a-db18-4512-a3c6-2e61a2c53a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1159735064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a09814-b36b-4ae9-a174-b05088814140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc83e1b6ed354693a682f3d328cf6694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:40:46Z,use_quota=True,user_id='28d981e8fbf14879bc23152c33cf22a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ce3a1b5-9b5d-486a-bbbf-4489589540b7),volume_type_id=7ce3a1b5-9b5d-486a-bbbf-4489589540b7)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0366522b-cf6d-4afe-adb9-68d4c15cfb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0366522b-cf6d-4afe-adb9-68d4c15cfb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc82457a-0d52-47c5-92c7-ccfde60f6541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG cinder.image.glance [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Creating Keystone auth plugin from conf {{(pid=91663) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 18 11:40:45 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c99f6a32-00d3-4268-8447-0fdbe9dff028 1073741824" returned: 0 in 0.994s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c99f6a32-00d3-4268-8447-0fdbe9dff028 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:45 devstack sudo[105549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c99f6a32-00d3-4268-8447-0fdbe9dff028
Jun 18 11:40:45 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc82457a-0d52-47c5-92c7-ccfde60f6541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b6a09814-b36b-4ae9-a174-b05088814140', 'volume_name': 'volume-b6a09814-b36b-4ae9-a174-b05088814140', 'volume_size': 1, 'image_id': 'c542b424-45a4-4561-a3f1-a81477e254c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c542b424-45a4-4561-a3f1-a81477e254c1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--325799964', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc83e1b6ed354693a682f3d328cf6694', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c542b424-45a4-4561-a3f1-a81477e254c1', 'created_at': datetime.datetime(2026, 6, 18, 9, 40, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 40, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c542b424-45a4-4561-a3f1-a81477e254c1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ff102dac0>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486c95c6-4f48-4c16-b897-6dd6eb26f729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486c95c6-4f48-4c16-b897-6dd6eb26f729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c05966-4c70-4c1f-bf5e-f164fd6797e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:46 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Volume b6a09814-b36b-4ae9-a174-b05088814140: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b6a09814-b36b-4ae9-a174-b05088814140', 'volume_size': 1, 'image_id': 'c542b424-45a4-4561-a3f1-a81477e254c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c542b424-45a4-4561-a3f1-a81477e254c1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--325799964', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc83e1b6ed354693a682f3d328cf6694', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c542b424-45a4-4561-a3f1-a81477e254c1', 'created_at': datetime.datetime(2026, 6, 18, 9, 40, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 40, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c542b424-45a4-4561-a3f1-a81477e254c1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ff102dac0>}
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Trying to clone b6a09814-b36b-4ae9-a174-b05088814140 from image c542b424-45a4-4561-a3f1-a81477e254c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c542b424-45a4-4561-a3f1-a81477e254c1', 'metadata': {}}]). {{(pid=91663) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 18 11:40:46 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c99f6a32-00d3-4268-8447-0fdbe9dff028" returned: 0 in 0.726s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.371s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-348377900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9412977a-598b-4f67-90c9-398de31b48ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc83e1b6ed354693a682f3d328cf6694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:40:45Z,use_quota=True,user_id='28d981e8fbf14879bc23152c33cf22a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cebb199-e1af-4e4e-89dc-f4ad8fa6404b),volume_type_id=2cebb199-e1af-4e4e-89dc-f4ad8fa6404b)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Creating volume 9412977a-598b-4f67-90c9-398de31b48ff {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:40:46 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9412977a-598b-4f67-90c9-398de31b48ff 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:46 devstack sudo[105552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9412977a-598b-4f67-90c9-398de31b48ff 1073741824
Jun 18 11:40:46 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6582ac4d-6fb9-4321-b607-66e82aa395cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c99f6a32-00d3-4268-8447-0fdbe9dff028', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360ebd63-5fb4-4ecc-89e4-c2365d635a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:46 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Volume volume-c99f6a32-00d3-4268-8447-0fdbe9dff028 (c99f6a32-00d3-4268-8447-0fdbe9dff028): created successfully
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360ebd63-5fb4-4ecc-89e4-c2365d635a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Flow 'volume_create_manager' (b617e676-b2cb-4b2b-8335-d89a0658f759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:40:46 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-35218b47-5279-465f-8d67-4dcb597c76b2 tempest-TestInstancesWithCinderVolumes-998917132 None] Created volume successfully.
Jun 18 11:40:47 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9412977a-598b-4f67-90c9-398de31b48ff 1073741824" returned: 0 in 0.914s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9412977a-598b-4f67-90c9-398de31b48ff {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:47 devstack sudo[105572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9412977a-598b-4f67-90c9-398de31b48ff
Jun 18 11:40:47 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:48 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9412977a-598b-4f67-90c9-398de31b48ff" returned: 0 in 0.779s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:40:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:40:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14142766-9a06-4806-b1fa-ef35fcfd7e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9412977a-598b-4f67-90c9-398de31b48ff', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f242257-58c0-4e70-80aa-786bd1cc2a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:48 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Volume volume-9412977a-598b-4f67-90c9-398de31b48ff (9412977a-598b-4f67-90c9-398de31b48ff): created successfully
Jun 18 11:40:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f242257-58c0-4e70-80aa-786bd1cc2a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Flow 'volume_create_manager' (7e668a99-4231-4098-b4ee-a1fbf20ae014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:40:48 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d4569015-cd5a-4c49-a737-28e91a4cf795 tempest-TestInstancesWithCinderVolumes-998917132 None] Created volume successfully.
Jun 18 11:40:49 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c542b424-45a4-4561-a3f1-a81477e254c1_1p9gszq5devstack@QuobyteHD, size 20.69 MB, duration 3.30 sec {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 18 11:40:49 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Image download 20.69 MB at 6.28 MB/s
Jun 18 11:40:49 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[820ace54-984b-442f-b42d-91c3aad346f4]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:40:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c542b424-45a4-4561-a3f1-a81477e254c1_1p9gszq5devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:49 devstack sudo[105576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c542b424-45a4-4561-a3f1-a81477e254c1_1p9gszq5devstack@QuobyteHD
Jun 18 11:40:49 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:50 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c542b424-45a4-4561-a3f1-a81477e254c1_1p9gszq5devstack@QuobyteHD" returned: 0 in 0.725s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:50 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Temporary image c542b424-45a4-4561-a3f1-a81477e254c1 is fetched for user 28d981e8fbf14879bc23152c33cf22a5. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 18 11:40:50 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab7a44d-bad4-4f59-a738-4e8a3851561d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:40:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c542b424-45a4-4561-a3f1-a81477e254c1_1p9gszq5devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:50 devstack sudo[105583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c542b424-45a4-4561-a3f1-a81477e254c1_1p9gszq5devstack@QuobyteHD
Jun 18 11:40:50 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:50 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c542b424-45a4-4561-a3f1-a81477e254c1_1p9gszq5devstack@QuobyteHD" returned: 0 in 0.721s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:40:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:40:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1159735064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a09814-b36b-4ae9-a174-b05088814140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc83e1b6ed354693a682f3d328cf6694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:40:46Z,use_quota=True,user_id='28d981e8fbf14879bc23152c33cf22a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ce3a1b5-9b5d-486a-bbbf-4489589540b7),volume_type_id=7ce3a1b5-9b5d-486a-bbbf-4489589540b7)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:40:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Creating volume b6a09814-b36b-4ae9-a174-b05088814140 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:40:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:40:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:40:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:40:51 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:40:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:40:51 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:40:51 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:40:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:51 devstack sudo[105588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140 1073741824
Jun 18 11:40:51 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:51 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140 1073741824" returned: 0 in 0.802s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:51 devstack sudo[105601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140
Jun 18 11:40:51 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:52 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140" returned: 0 in 0.641s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:40:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:40:52 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Attempting download of c542b424-45a4-4561-a3f1-a81477e254c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c542b424-45a4-4561-a3f1-a81477e254c1', 'metadata': {}}])) to volume b6a09814-b36b-4ae9-a174-b05088814140. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 18 11:40:52 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e2623c-df6a-4d82-866e-a065bf3f9112]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:40:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c542b424-45a4-4561-a3f1-a81477e254c1_udvvsg1z {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:52 devstack sudo[105604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c542b424-45a4-4561-a3f1-a81477e254c1_udvvsg1z
Jun 18 11:40:52 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:53 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c542b424-45a4-4561-a3f1-a81477e254c1_udvvsg1z" returned: 0 in 0.738s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c542b424-45a4-4561-a3f1-a81477e254c1_udvvsg1z {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:53 devstack sudo[105608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c542b424-45a4-4561-a3f1-a81477e254c1_udvvsg1z
Jun 18 11:40:53 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:53 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c542b424-45a4-4561-a3f1-a81477e254c1_udvvsg1z" returned: 1 in 0.700s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c542b424-45a4-4561-a3f1-a81477e254c1_udvvsg1z' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:40:53 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[8343dd25-7c5b-45a2-94d3-ad595e2ceaaf]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:40:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c542b424-45a4-4561-a3f1-a81477e254c1_1p9gszq5devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:54 devstack sudo[105612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c542b424-45a4-4561-a3f1-a81477e254c1_1p9gszq5devstack@QuobyteHD
Jun 18 11:40:54 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:54 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c542b424-45a4-4561-a3f1-a81477e254c1_1p9gszq5devstack@QuobyteHD" returned: 0 in 0.733s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:54 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] c542b424-45a4-4561-a3f1-a81477e254c1 was qcow2, converting to raw {{(pid=91663) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 18 11:40:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c542b424-45a4-4561-a3f1-a81477e254c1_1p9gszq5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:54 devstack sudo[105617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c542b424-45a4-4561-a3f1-a81477e254c1_1p9gszq5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140
Jun 18 11:40:54 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:56 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c542b424-45a4-4561-a3f1-a81477e254c1_1p9gszq5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140" returned: 0 in 1.864s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:56 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c542b424-45a4-4561-a3f1-a81477e254c1_1p9gszq5devstack@QuobyteHD, size 112.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140 {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:40:56 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Converted 112.00 MB image at 60.04 MB/s
Jun 18 11:40:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:56 devstack sudo[105624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140 1G
Jun 18 11:40:56 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:57 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140 1G" returned: 0 in 0.664s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:57 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0a04c8-eb32-42d6-9a6e-385e3d96d960]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:40:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:57 devstack sudo[105629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140
Jun 18 11:40:57 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:58 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140" returned: 0 in 0.746s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:40:58 devstack sudo[105633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140
Jun 18 11:40:58 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:40:58 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root
Jun 18 11:40:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140" returned: 1 in 0.735s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:40:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:40:58 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Downloaded image c542b424-45a4-4561-a3f1-a81477e254c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c542b424-45a4-4561-a3f1-a81477e254c1', 'metadata': {}}])) to volume b6a09814-b36b-4ae9-a174-b05088814140 successfully. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 18 11:40:58 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Temporary image c542b424-45a4-4561-a3f1-a81477e254c1 for user 28d981e8fbf14879bc23152c33cf22a5 is deleted. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 18 11:40:58 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Marking volume b6a09814-b36b-4ae9-a174-b05088814140 as bootable. {{(pid=91663) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 18 11:40:58 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Copying metadata from image c542b424-45a4-4561-a3f1-a81477e254c1 to b6a09814-b36b-4ae9-a174-b05088814140. {{(pid=91663) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 18 11:40:58 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Creating volume glance metadata for volume b6a09814-b36b-4ae9-a174-b05088814140 backed by image c542b424-45a4-4561-a3f1-a81477e254c1 with: {'image_id': 'c542b424-45a4-4561-a3f1-a81477e254c1', 'image_name': 'tempest-scenario-img--325799964', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91663) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 18 11:40:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c05966-4c70-4c1f-bf5e-f164fd6797e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6a09814-b36b-4ae9-a174-b05088814140', 'volume_size': 1, 'image_id': 'c542b424-45a4-4561-a3f1-a81477e254c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c542b424-45a4-4561-a3f1-a81477e254c1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--325799964', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc83e1b6ed354693a682f3d328cf6694', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c542b424-45a4-4561-a3f1-a81477e254c1', 'created_at': datetime.datetime(2026, 6, 18, 9, 40, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 40, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c542b424-45a4-4561-a3f1-a81477e254c1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ff102dac0>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (840edf79-86a2-4cc7-970c-c1ed25f5e60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:40:58 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Volume volume-b6a09814-b36b-4ae9-a174-b05088814140 (b6a09814-b36b-4ae9-a174-b05088814140): created successfully
Jun 18 11:40:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (840edf79-86a2-4cc7-970c-c1ed25f5e60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:40:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Flow 'volume_create_manager' (f48e969d-bb43-4581-90cb-9887ba23b2a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:40:58 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-e44acb88-e96b-4662-9cbd-309a828173ad tempest-TestInstancesWithCinderVolumes-998917132 None] Created volume successfully.
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Flow 'volume_create_manager' (869c31b2-c7bd-4f04-b3b6-e30289488eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567949c7-916c-441e-ae82-5b863c1cfd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567949c7-916c-441e-ae82-5b863c1cfd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1647333848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a13605-684c-4aee-84c2-a18322baf1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa25e0d7e8cd46dd8924363731bb65c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:41:03Z,use_quota=True,user_id='8c323617de0e49d98c602fff069b4951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870897f5-f072-49ed-afd1-1af4dd95f5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870897f5-f072-49ed-afd1-1af4dd95f5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12516583-f8f9-44ae-a8a8-ac74b052ad11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12516583-f8f9-44ae-a8a8-ac74b052ad11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38a13605-684c-4aee-84c2-a18322baf1a5', 'volume_name': 'volume-38a13605-684c-4aee-84c2-a18322baf1a5', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576d714f-1af9-44bf-afbc-51156e1e8276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576d714f-1af9-44bf-afbc-51156e1e8276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7205f5af-c754-474b-b9f9-6c27feef2038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:41:02 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Volume 38a13605-684c-4aee-84c2-a18322baf1a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38a13605-684c-4aee-84c2-a18322baf1a5', 'volume_size': 1}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1647333848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a13605-684c-4aee-84c2-a18322baf1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa25e0d7e8cd46dd8924363731bb65c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:41:03Z,use_quota=True,user_id='8c323617de0e49d98c602fff069b4951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Creating volume 38a13605-684c-4aee-84c2-a18322baf1a5 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:41:02 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:41:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-38a13605-684c-4aee-84c2-a18322baf1a5 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:41:02 devstack sudo[105645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-38a13605-684c-4aee-84c2-a18322baf1a5 1073741824
Jun 18 11:41:02 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:41:03 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root
Jun 18 11:41:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-38a13605-684c-4aee-84c2-a18322baf1a5 1073741824" returned: 0 in 0.831s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:41:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-38a13605-684c-4aee-84c2-a18322baf1a5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:41:03 devstack sudo[105653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-38a13605-684c-4aee-84c2-a18322baf1a5
Jun 18 11:41:03 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:41:04 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root
Jun 18 11:41:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-38a13605-684c-4aee-84c2-a18322baf1a5" returned: 0 in 0.627s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:41:04 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:41:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:41:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7205f5af-c754-474b-b9f9-6c27feef2038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38a13605-684c-4aee-84c2-a18322baf1a5', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:41:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aae9db1-7999-4819-bacc-11b7335e3d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:41:04 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Volume volume-38a13605-684c-4aee-84c2-a18322baf1a5 (38a13605-684c-4aee-84c2-a18322baf1a5): created successfully
Jun 18 11:41:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aae9db1-7999-4819-bacc-11b7335e3d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:41:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Flow 'volume_create_manager' (869c31b2-c7bd-4f04-b3b6-e30289488eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:41:04 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-955b0919-cc27-4812-b425-71cf447dd12b tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Created volume successfully.
Jun 18 11:41:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-6baf1d2e-3bec-4a30-9866-8769ad7a5308 req-0b453345-2e66-4229-aebe-bee15f7752ac tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:41:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-6baf1d2e-3bec-4a30-9866-8769ad7a5308 req-0b453345-2e66-4229-aebe-bee15f7752ac tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:41:06 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3a9f98-0fa7-40d4-9da3-7063aa63dde8]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:41:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-6baf1d2e-3bec-4a30-9866-8769ad7a5308 req-0b453345-2e66-4229-aebe-bee15f7752ac tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:41:06 devstack sudo[105674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140
Jun 18 11:41:06 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:41:07 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root
Jun 18 11:41:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-6baf1d2e-3bec-4a30-9866-8769ad7a5308 req-0b453345-2e66-4229-aebe-bee15f7752ac tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140" returned: 0 in 0.810s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:41:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-6baf1d2e-3bec-4a30-9866-8769ad7a5308 req-0b453345-2e66-4229-aebe-bee15f7752ac tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:41:07 devstack sudo[105678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140
Jun 18 11:41:07 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:41:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-57df21e8-573a-4cf8-ad24-4edbce1a773c req-7c9c0606-edc0-4896-87a8-29fecd4557e0 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:41:08 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root
Jun 18 11:41:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-6baf1d2e-3bec-4a30-9866-8769ad7a5308 req-0b453345-2e66-4229-aebe-bee15f7752ac tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140" returned: 1 in 0.730s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:41:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-6baf1d2e-3bec-4a30-9866-8769ad7a5308 req-0b453345-2e66-4229-aebe-bee15f7752ac tempest-TestInstancesWithCinderVolumes-998917132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:41:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-6baf1d2e-3bec-4a30-9866-8769ad7a5308 req-0b453345-2e66-4229-aebe-bee15f7752ac tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.588s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:41:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-57df21e8-573a-4cf8-ad24-4edbce1a773c req-7c9c0606-edc0-4896-87a8-29fecd4557e0 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.328s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:41:08 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e50d03-cc5f-44ca-a1a5-24ac93d8d4a2]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:41:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-57df21e8-573a-4cf8-ad24-4edbce1a773c req-7c9c0606-edc0-4896-87a8-29fecd4557e0 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-38a13605-684c-4aee-84c2-a18322baf1a5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:41:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-6baf1d2e-3bec-4a30-9866-8769ad7a5308 req-0b453345-2e66-4229-aebe-bee15f7752ac tempest-TestInstancesWithCinderVolumes-998917132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-b6a09814-b36b-4ae9-a174-b05088814140', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '19f2add9-52c0-43cf-bec3-e217a1c50434', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:41:08 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-6baf1d2e-3bec-4a30-9866-8769ad7a5308 req-0b453345-2e66-4229-aebe-bee15f7752ac tempest-TestInstancesWithCinderVolumes-998917132 None] attachment_update completed successfully.
Jun 18 11:41:08 devstack sudo[105691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-38a13605-684c-4aee-84c2-a18322baf1a5
Jun 18 11:41:08 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:41:08 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root
Jun 18 11:41:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-57df21e8-573a-4cf8-ad24-4edbce1a773c req-7c9c0606-edc0-4896-87a8-29fecd4557e0 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-38a13605-684c-4aee-84c2-a18322baf1a5" returned: 0 in 0.793s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:41:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-57df21e8-573a-4cf8-ad24-4edbce1a773c req-7c9c0606-edc0-4896-87a8-29fecd4557e0 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.811s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:41:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-57df21e8-573a-4cf8-ad24-4edbce1a773c req-7c9c0606-edc0-4896-87a8-29fecd4557e0 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-38a13605-684c-4aee-84c2-a18322baf1a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fffb1714-59a2-4cdf-9051-c1c4063d66a2', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:41:09 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-57df21e8-573a-4cf8-ad24-4edbce1a773c req-7c9c0606-edc0-4896-87a8-29fecd4557e0 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] attachment_update completed successfully.
Jun 18 11:41:16 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-b3a13fa3-0a50-4c92-8274-1a17864f17e2 req-228c45b3-9c12-4816-99e2-ae65d1ab07e1 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Terminate volume connection completed successfully.
Jun 18 11:41:16 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-b3a13fa3-0a50-4c92-8274-1a17864f17e2 req-228c45b3-9c12-4816-99e2-ae65d1ab07e1 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Deleting attachment fffb1714-59a2-4cdf-9051-c1c4063d66a2. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:41:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Acquiring lock "cinder-38a13605-684c-4aee-84c2-a18322baf1a5-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:41:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Lock "cinder-38a13605-684c-4aee-84c2-a18322baf1a5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:41:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Acquiring lock "cinder-quobyte-38a13605-684c-4aee-84c2-a18322baf1a5" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:41:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Lock "cinder-quobyte-38a13605-684c-4aee-84c2-a18322baf1a5" acquired by "delete_volume" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:41:18 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e2a6bc-1022-45b4-91ef-f65077c80f0f]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:41:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-38a13605-684c-4aee-84c2-a18322baf1a5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:41:19 devstack sudo[106152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-38a13605-684c-4aee-84c2-a18322baf1a5
Jun 18 11:41:19 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:41:19 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root
Jun 18 11:41:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-38a13605-684c-4aee-84c2-a18322baf1a5" returned: 0 in 0.951s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:41:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-38a13605-684c-4aee-84c2-a18322baf1a5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:41:19 devstack sudo[106158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-38a13605-684c-4aee-84c2-a18322baf1a5
Jun 18 11:41:19 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:41:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-38a13605-684c-4aee-84c2-a18322baf1a5" returned: 0 in 0.785s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:41:20 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root
Jun 18 11:41:20 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Lock "cinder-quobyte-38a13605-684c-4aee-84c2-a18322baf1a5" released by "delete_volume" :: held 1.802s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:41:20 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Created reservations ['3c90a149-e95e-46db-abe6-74a88d4e55d6', '011e8900-f0a9-4fc6-aa85-9e7379490f68', 'a659c41b-f9f2-4305-a7bf-65a8ed62ef3f', 'ab47c656-a6a5-4d3b-beea-b37886976265'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:41:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:41:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:41:20 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:41:20 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:41:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:41:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:41:20 devstack sudo[106161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:41:20 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:41:21 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root
Jun 18 11:41:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.888s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:41:21 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:41:21 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Deleted volume successfully.
Jun 18 11:41:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-40f21024-7f12-4795-805f-cfc240a42ba6 tempest-TestServerVolumeAttachScenarioOldVersion-1040065918 None] Lock "cinder-38a13605-684c-4aee-84c2-a18322baf1a5-delete_volume" released by "delete_volume" :: held 2.985s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:41:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:41:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:41:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:41:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:41:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:41:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:41:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:41:25 devstack sudo[106241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:41:25 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:41:26 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root
Jun 18 11:41:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.656s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:41:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:41:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:41:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:41:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:41:30 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:UPDATE=23,cinder:SELECT=25,cinder:DELETE=3,cinder:INSERT=11 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:41:31 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=36,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=2 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:41:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-d260b85b-a169-4b11-8bc7-6342b4e17e84 req-1c486229-6374-4398-9102-a335af5c4dae tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:41:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-d260b85b-a169-4b11-8bc7-6342b4e17e84 req-1c486229-6374-4398-9102-a335af5c4dae tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:41:46 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[371c0f44-786b-49e1-98ec-b4f5a5b22201]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:41:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-d260b85b-a169-4b11-8bc7-6342b4e17e84 req-1c486229-6374-4398-9102-a335af5c4dae tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c99f6a32-00d3-4268-8447-0fdbe9dff028 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:41:46 devstack sudo[106365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c99f6a32-00d3-4268-8447-0fdbe9dff028
Jun 18 11:41:46 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:41:47 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root
Jun 18 11:41:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-d260b85b-a169-4b11-8bc7-6342b4e17e84 req-1c486229-6374-4398-9102-a335af5c4dae tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c99f6a32-00d3-4268-8447-0fdbe9dff028" returned: 0 in 0.797s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:41:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-d260b85b-a169-4b11-8bc7-6342b4e17e84 req-1c486229-6374-4398-9102-a335af5c4dae tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.819s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:41:47 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-d260b85b-a169-4b11-8bc7-6342b4e17e84 req-1c486229-6374-4398-9102-a335af5c4dae tempest-TestInstancesWithCinderVolumes-998917132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-c99f6a32-00d3-4268-8447-0fdbe9dff028', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '208ac948-02be-44a2-a630-5804d9473db8', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:41:47 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-d260b85b-a169-4b11-8bc7-6342b4e17e84 req-1c486229-6374-4398-9102-a335af5c4dae tempest-TestInstancesWithCinderVolumes-998917132 None] attachment_update completed successfully.
Jun 18 11:41:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-6e009512-b0e6-4baf-bd97-b6bc3e9ec8fb req-e1e9bc80-d3f2-4fe5-86a2-20d89ff2d28d tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:41:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-6e009512-b0e6-4baf-bd97-b6bc3e9ec8fb req-e1e9bc80-d3f2-4fe5-86a2-20d89ff2d28d tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:41:54 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0367b0-5325-4971-8ddb-35768b92fea4]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:41:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-6e009512-b0e6-4baf-bd97-b6bc3e9ec8fb req-e1e9bc80-d3f2-4fe5-86a2-20d89ff2d28d tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9412977a-598b-4f67-90c9-398de31b48ff {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:41:55 devstack sudo[106394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9412977a-598b-4f67-90c9-398de31b48ff
Jun 18 11:41:55 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:41:55 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root
Jun 18 11:41:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-6e009512-b0e6-4baf-bd97-b6bc3e9ec8fb req-e1e9bc80-d3f2-4fe5-86a2-20d89ff2d28d tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9412977a-598b-4f67-90c9-398de31b48ff" returned: 0 in 0.822s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:41:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-6e009512-b0e6-4baf-bd97-b6bc3e9ec8fb req-e1e9bc80-d3f2-4fe5-86a2-20d89ff2d28d tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.848s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:41:55 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-6e009512-b0e6-4baf-bd97-b6bc3e9ec8fb req-e1e9bc80-d3f2-4fe5-86a2-20d89ff2d28d tempest-TestInstancesWithCinderVolumes-998917132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-9412977a-598b-4f67-90c9-398de31b48ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01d7aa1f-ce02-467e-9b27-9c56b7853f0f', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:41:55 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-6e009512-b0e6-4baf-bd97-b6bc3e9ec8fb req-e1e9bc80-d3f2-4fe5-86a2-20d89ff2d28d tempest-TestInstancesWithCinderVolumes-998917132 None] attachment_update completed successfully.
Jun 18 11:42:02 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:42:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Flow 'volume_create_manager' (680d1c8a-5c06-4fac-ad1c-e769ea4f99a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:42:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53dff8b4-9505-403d-a388-310fc6348f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:42:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53dff8b4-9505-403d-a388-310fc6348f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-775298892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee9e3b2-6393-4499-9c4e-efa35607c3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b0b8c6c4ba48d0853dc1295e06326e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:42:03Z,use_quota=True,user_id='c6ad8827fd5b46f0931b8322e4aeaf11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:42:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918290d7-f263-4188-b673-40bd3ed05fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:42:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918290d7-f263-4188-b673-40bd3ed05fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:42:02 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d2826d-13ed-4901-9e81-e7cc830b9173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:42:02 devstack cinder-volume[91663]: DEBUG cinder.image.glance [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Creating Keystone auth plugin from conf {{(pid=91663) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 18 11:42:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d2826d-13ed-4901-9e81-e7cc830b9173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ee9e3b2-6393-4499-9c4e-efa35607c3aa', 'volume_name': 'volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa', 'volume_size': 1, 'image_id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767e7f9d16154dd1a44a1bc208ee9108', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'created_at': datetime.datetime(2026, 6, 18, 9, 18, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 18, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ff0dea480>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:42:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418d3440-c2d7-439e-9976-f75c83c50e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:42:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418d3440-c2d7-439e-9976-f75c83c50e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:42:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ba1289-4953-40e0-8cb1-38210cdabccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:42:03 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Volume 4ee9e3b2-6393-4499-9c4e-efa35607c3aa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa', 'volume_size': 1, 'image_id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767e7f9d16154dd1a44a1bc208ee9108', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'created_at': datetime.datetime(2026, 6, 18, 9, 18, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 18, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ff0dea480>}
Jun 18 11:42:03 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Trying to clone 4ee9e3b2-6393-4499-9c4e-efa35607c3aa from image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 at location (None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}]). {{(pid=91663) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 18 11:42:03 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b2sqq1z7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 18 11:42:03 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Image download 20.69 MB at 20.69 MB/s
Jun 18 11:42:03 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e1b7af-c892-4c72-9d37-0ce715027702]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:42:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b2sqq1z7devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:03 devstack sudo[106437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b2sqq1z7devstack@QuobyteHD
Jun 18 11:42:03 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:04 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b2sqq1z7devstack@QuobyteHD" returned: 0 in 0.727s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:04 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Temporary image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 is fetched for user c6ad8827fd5b46f0931b8322e4aeaf11. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 18 11:42:04 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaac1c3-b616-4c4b-8891-b91521f119e8]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:42:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b2sqq1z7devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:04 devstack sudo[106442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b2sqq1z7devstack@QuobyteHD
Jun 18 11:42:04 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:04 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-78bb0106-0b93-4f64-8ad3-0544f94ff53b req-37e323a8-f13b-4a17-a386-c1609f47fc08 tempest-TestInstancesWithCinderVolumes-998917132 None] Terminate volume connection completed successfully.
Jun 18 11:42:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-78bb0106-0b93-4f64-8ad3-0544f94ff53b req-37e323a8-f13b-4a17-a386-c1609f47fc08 tempest-TestInstancesWithCinderVolumes-998917132 None] Deleting attachment 208ac948-02be-44a2-a630-5804d9473db8. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:42:05 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b2sqq1z7devstack@QuobyteHD" returned: 0 in 0.747s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:42:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:42:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-775298892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee9e3b2-6393-4499-9c4e-efa35607c3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b0b8c6c4ba48d0853dc1295e06326e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:42:03Z,use_quota=True,user_id='c6ad8827fd5b46f0931b8322e4aeaf11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:42:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Creating volume 4ee9e3b2-6393-4499-9c4e-efa35607c3aa {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:42:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:42:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:42:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:42:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:42:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:42:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:42:05 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:42:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:05 devstack sudo[106449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa 1073741824
Jun 18 11:42:05 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:05 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa 1073741824" returned: 0 in 0.810s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:05 devstack sudo[106457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa
Jun 18 11:42:05 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:06 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa" returned: 0 in 0.634s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:42:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:42:06 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Attempting download of 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 ((None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}])) to volume 4ee9e3b2-6393-4499-9c4e-efa35607c3aa. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 18 11:42:06 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfa3509-a9e2-48b6-bc12-0b8344238455]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:42:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_th_g659r {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:06 devstack sudo[106466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_th_g659r
Jun 18 11:42:06 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:06 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "cinder-c99f6a32-00d3-4268-8447-0fdbe9dff028-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:42:06 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "cinder-c99f6a32-00d3-4268-8447-0fdbe9dff028-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:42:06 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "cinder-quobyte-c99f6a32-00d3-4268-8447-0fdbe9dff028" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:42:06 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "cinder-quobyte-c99f6a32-00d3-4268-8447-0fdbe9dff028" acquired by "delete_volume" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:42:06 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17fa45a-e5d3-4fc6-ac3d-ceded20213b8]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:42:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c99f6a32-00d3-4268-8447-0fdbe9dff028 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:06 devstack sudo[106470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c99f6a32-00d3-4268-8447-0fdbe9dff028
Jun 18 11:42:06 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:07 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_th_g659r" returned: 0 in 0.793s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_th_g659r {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:07 devstack sudo[106476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_th_g659r
Jun 18 11:42:07 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:07 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c99f6a32-00d3-4268-8447-0fdbe9dff028" returned: 0 in 0.815s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c99f6a32-00d3-4268-8447-0fdbe9dff028 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:07 devstack sudo[106481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c99f6a32-00d3-4268-8447-0fdbe9dff028
Jun 18 11:42:07 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:08 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_th_g659r" returned: 1 in 0.791s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_th_g659r' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:42:08 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca63ac8-ed98-447d-a436-ecf735fa50d4]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:42:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b2sqq1z7devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:08 devstack sudo[106485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b2sqq1z7devstack@QuobyteHD
Jun 18 11:42:08 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:08 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c99f6a32-00d3-4268-8447-0fdbe9dff028" returned: 0 in 0.702s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:08 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "cinder-quobyte-c99f6a32-00d3-4268-8447-0fdbe9dff028" released by "delete_volume" :: held 1.569s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:42:08 devstack cinder-volume[91663]: WARNING cinder.quota [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1176113925-1568589223 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1176113925-1568589223, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:42:08 devstack cinder-volume[91663]: WARNING cinder.quota [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1176113925-1568589223 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1176113925-1568589223, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:42:08 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Created reservations ['c1edf03f-d82c-4011-9ccd-ea25e92bd49c', '4fa065c9-dfac-4746-9725-d27ab4afa802', 'b64ebfa2-7b0f-4eb0-a4e2-9ea3e9cf901d', '0f587ff9-4c82-4c1f-a60b-2e7d900fc18b'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:42:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:42:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:42:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:42:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:42:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:42:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:08 devstack sudo[106490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:42:08 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:08 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b2sqq1z7devstack@QuobyteHD" returned: 0 in 0.781s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:08 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 was qcow2, converting to raw {{(pid=91663) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 18 11:42:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b2sqq1z7devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:08 devstack sudo[106504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b2sqq1z7devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa
Jun 18 11:42:08 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:09 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.666s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:09 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:42:09 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Deleted volume successfully.
Jun 18 11:42:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a9836cdd-dbd9-49ef-880d-923ef8948370 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "cinder-c99f6a32-00d3-4268-8447-0fdbe9dff028-delete_volume" released by "delete_volume" :: held 2.464s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:42:10 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b2sqq1z7devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa" returned: 0 in 1.917s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:10 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_147c2a7c-0b5c-4f52-8d7c-17b03a29d117_b2sqq1z7devstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:42:10 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Converted 112.00 MB image at 58.39 MB/s
Jun 18 11:42:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:10 devstack sudo[106529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa 1G
Jun 18 11:42:10 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:11 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-9e7d292d-8d29-48f1-9fe6-80c4d07be9f6 req-3b9e0eb3-f79c-4001-a36d-ff4cbead215b tempest-TestInstancesWithCinderVolumes-998917132 None] Terminate volume connection completed successfully.
Jun 18 11:42:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-9e7d292d-8d29-48f1-9fe6-80c4d07be9f6 req-3b9e0eb3-f79c-4001-a36d-ff4cbead215b tempest-TestInstancesWithCinderVolumes-998917132 None] Deleting attachment 01d7aa1f-ce02-467e-9b27-9c56b7853f0f. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:42:11 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa 1G" returned: 0 in 0.685s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:11 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f50e03-c9d1-43fb-946b-08ec2b63665c]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:42:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:11 devstack sudo[106536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa
Jun 18 11:42:11 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:12 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa" returned: 0 in 0.752s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:12 devstack sudo[106540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa
Jun 18 11:42:12 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "cinder-9412977a-598b-4f67-90c9-398de31b48ff-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:42:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "cinder-9412977a-598b-4f67-90c9-398de31b48ff-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:42:13 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa" returned: 1 in 0.787s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:42:13 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Downloaded image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 ((None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}])) to volume 4ee9e3b2-6393-4499-9c4e-efa35607c3aa successfully. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 18 11:42:13 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Temporary image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 for user c6ad8827fd5b46f0931b8322e4aeaf11 is deleted. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 18 11:42:13 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Marking volume 4ee9e3b2-6393-4499-9c4e-efa35607c3aa as bootable. {{(pid=91663) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 18 11:42:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "cinder-quobyte-9412977a-598b-4f67-90c9-398de31b48ff" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:42:13 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Copying metadata from image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 to 4ee9e3b2-6393-4499-9c4e-efa35607c3aa. {{(pid=91663) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 18 11:42:13 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Creating volume glance metadata for volume 4ee9e3b2-6393-4499-9c4e-efa35607c3aa backed by image 147c2a7c-0b5c-4f52-8d7c-17b03a29d117 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91663) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 18 11:42:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "cinder-quobyte-9412977a-598b-4f67-90c9-398de31b48ff" acquired by "delete_volume" :: waited 0.023s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:42:13 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[808512f9-07fb-4cc7-bc48-996d843de297]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:42:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9412977a-598b-4f67-90c9-398de31b48ff {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ba1289-4953-40e0-8cb1-38210cdabccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa', 'volume_size': 1, 'image_id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767e7f9d16154dd1a44a1bc208ee9108', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '147c2a7c-0b5c-4f52-8d7c-17b03a29d117', 'created_at': datetime.datetime(2026, 6, 18, 9, 18, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 18, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/147c2a7c-0b5c-4f52-8d7c-17b03a29d117/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ff0dea480>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:42:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25194041-524e-414e-8105-b89a76135cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:42:13 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Volume volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa (4ee9e3b2-6393-4499-9c4e-efa35607c3aa): created successfully
Jun 18 11:42:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25194041-524e-414e-8105-b89a76135cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:42:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Flow 'volume_create_manager' (680d1c8a-5c06-4fac-ad1c-e769ea4f99a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:42:13 devstack sudo[106545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9412977a-598b-4f67-90c9-398de31b48ff
Jun 18 11:42:13 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:13 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-e8f1c211-ba5f-439b-baf0-f4ea288532e5 tempest-TestShelveInstance-576764930 None] Created volume successfully.
Jun 18 11:42:13 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9412977a-598b-4f67-90c9-398de31b48ff" returned: 0 in 0.793s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9412977a-598b-4f67-90c9-398de31b48ff {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:14 devstack sudo[106550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9412977a-598b-4f67-90c9-398de31b48ff
Jun 18 11:42:14 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:14 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9412977a-598b-4f67-90c9-398de31b48ff" returned: 0 in 0.725s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "cinder-quobyte-9412977a-598b-4f67-90c9-398de31b48ff" released by "delete_volume" :: held 1.571s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:42:14 devstack cinder-volume[91663]: WARNING cinder.quota [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1181398140-986952964 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1181398140-986952964, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:42:14 devstack cinder-volume[91663]: WARNING cinder.quota [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1181398140-986952964 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1181398140-986952964, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:42:14 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Created reservations ['9fcc91e0-fa87-47b9-a90b-342c6bb2ea98', '18e887bb-163b-4e42-9ccd-2a32d27d6e77', 'b51a6010-825b-4efb-a0c3-7b23ffed1037', 'df4ecae9-a066-40bc-b8b3-12e9991d48c5'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:42:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:42:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:42:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:42:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:42:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:42:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:14 devstack sudo[106554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:42:14 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:15 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.745s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:15 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:42:15 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Deleted volume successfully.
Jun 18 11:42:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-edff1773-d279-46a3-a6e2-a98f09e9f367 tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "cinder-9412977a-598b-4f67-90c9-398de31b48ff-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:42:19 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-618ebd50-bebe-4dd7-bb4a-d3802e3a7151 req-c167e9aa-b432-459c-a7e7-15e478f4182e tempest-TestInstancesWithCinderVolumes-998917132 None] Terminate volume connection completed successfully.
Jun 18 11:42:19 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-618ebd50-bebe-4dd7-bb4a-d3802e3a7151 req-c167e9aa-b432-459c-a7e7-15e478f4182e tempest-TestInstancesWithCinderVolumes-998917132 None] Deleting attachment 19f2add9-52c0-43cf-bec3-e217a1c50434. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:42:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-90e8f732-e0c8-4db8-8e34-e34f7487bbc4 req-9faa9f5b-54bf-405d-80d6-27771b992e30 tempest-TestShelveInstance-576764930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:42:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-90e8f732-e0c8-4db8-8e34-e34f7487bbc4 req-9faa9f5b-54bf-405d-80d6-27771b992e30 tempest-TestShelveInstance-576764930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:42:22 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[637db421-80b0-4aad-a159-075c90ce52cf]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:42:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-90e8f732-e0c8-4db8-8e34-e34f7487bbc4 req-9faa9f5b-54bf-405d-80d6-27771b992e30 tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:22 devstack sudo[106615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa
Jun 18 11:42:22 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:22 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-90e8f732-e0c8-4db8-8e34-e34f7487bbc4 req-9faa9f5b-54bf-405d-80d6-27771b992e30 tempest-TestShelveInstance-576764930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa" returned: 0 in 0.796s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-90e8f732-e0c8-4db8-8e34-e34f7487bbc4 req-9faa9f5b-54bf-405d-80d6-27771b992e30 tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:23 devstack sudo[106619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa
Jun 18 11:42:23 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "cinder-b6a09814-b36b-4ae9-a174-b05088814140-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:42:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "cinder-b6a09814-b36b-4ae9-a174-b05088814140-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:42:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "cinder-quobyte-b6a09814-b36b-4ae9-a174-b05088814140" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:42:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "cinder-quobyte-b6a09814-b36b-4ae9-a174-b05088814140" acquired by "delete_volume" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:42:23 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b855b7-0827-4023-aa1e-f5be4b768937]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:42:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:23 devstack sudo[106621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140
Jun 18 11:42:23 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:23 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-90e8f732-e0c8-4db8-8e34-e34f7487bbc4 req-9faa9f5b-54bf-405d-80d6-27771b992e30 tempest-TestShelveInstance-576764930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa" returned: 1 in 0.801s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-90e8f732-e0c8-4db8-8e34-e34f7487bbc4 req-9faa9f5b-54bf-405d-80d6-27771b992e30 tempest-TestShelveInstance-576764930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:42:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-90e8f732-e0c8-4db8-8e34-e34f7487bbc4 req-9faa9f5b-54bf-405d-80d6-27771b992e30 tempest-TestShelveInstance-576764930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.640s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:42:23 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-90e8f732-e0c8-4db8-8e34-e34f7487bbc4 req-9faa9f5b-54bf-405d-80d6-27771b992e30 tempest-TestShelveInstance-576764930 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8361a10d-329e-4bd8-9dd9-d2d03d2f9494', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:42:23 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-90e8f732-e0c8-4db8-8e34-e34f7487bbc4 req-9faa9f5b-54bf-405d-80d6-27771b992e30 tempest-TestShelveInstance-576764930 None] attachment_update completed successfully.
Jun 18 11:42:24 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140" returned: 0 in 0.782s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:24 devstack sudo[106664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140
Jun 18 11:42:24 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:24 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140" returned: 1 in 0.801s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:42:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:24 devstack sudo[106669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140
Jun 18 11:42:24 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:42:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:42:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:42:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:42:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:42:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:42:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:25 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-b6a09814-b36b-4ae9-a174-b05088814140" returned: 0 in 0.646s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:25 devstack sudo[106672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:42:25 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "cinder-quobyte-b6a09814-b36b-4ae9-a174-b05088814140" released by "delete_volume" :: held 2.295s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:42:25 devstack cinder-volume[91663]: WARNING cinder.quota [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1962163110-1756310653 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1962163110-1756310653, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:42:25 devstack cinder-volume[91663]: WARNING cinder.quota [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1962163110-1756310653 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1962163110-1756310653, it is now deprecated. Please use the default quota class for default quota.
Jun 18 11:42:25 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Created reservations ['b963b0b4-c903-48e5-a5f0-09987fc3f0d4', 'd01d3e5e-bb27-4efc-9e73-f6829bd9931f', '4677724e-07b2-41b6-a171-5f6301a7f297', '0557d487-f383-4fbc-83c3-b38fd674d1ea'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:42:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:42:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:42:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:42:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:42:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:42:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:25 devstack sudo[106674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:42:25 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:26 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.663s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:42:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:42:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:42:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:42:26 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.675s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:42:26 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Deleted volume successfully.
Jun 18 11:42:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-1c4b4bcb-5a2f-472f-bd60-b5147672176f tempest-TestInstancesWithCinderVolumes-998917132 None] Lock "cinder-b6a09814-b36b-4ae9-a174-b05088814140-delete_volume" released by "delete_volume" :: held 3.184s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:42:35 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=43,cinder:UPDATE=31,cinder:INSERT=13,cinder:DELETE=1 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:42:36 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:UPDATE=36,cinder:SELECT=46,cinder:INSERT=13,cinder:DELETE=3 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Flow 'volume_create_manager' (ba3658ae-fa85-44b9-aa42-cb7d2700cd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8fab42f-2c98-4aac-aae5-924b26353c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8fab42f-2c98-4aac-aae5-924b26353c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-617520982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3987a53f-cb7a-4869-8aab-bdeb8e923f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79753e09cea1404caf03985c332bd23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:42:57Z,use_quota=True,user_id='6e17b21a130f4967a174b56de90c5681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981b8d7f-4d33-4043-9f12-a2a11ae657ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981b8d7f-4d33-4043-9f12-a2a11ae657ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ecf3db-b677-49e1-82e6-dd63b340a973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ecf3db-b677-49e1-82e6-dd63b340a973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3987a53f-cb7a-4869-8aab-bdeb8e923f77', 'volume_name': 'volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ceb275-8abc-41d3-9235-ef508348c5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ceb275-8abc-41d3-9235-ef508348c5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3d50da-2fe9-4553-80a6-bbf781fb3e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:42:57 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Volume 3987a53f-cb7a-4869-8aab-bdeb8e923f77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77', 'volume_size': 1}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-617520982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3987a53f-cb7a-4869-8aab-bdeb8e923f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79753e09cea1404caf03985c332bd23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:42:57Z,use_quota=True,user_id='6e17b21a130f4967a174b56de90c5681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Creating volume 3987a53f-cb7a-4869-8aab-bdeb8e923f77 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:42:57 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:57 devstack sudo[107253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77 1073741824
Jun 18 11:42:57 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:42:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Flow 'volume_create_manager' (67cbdaaa-b4c8-4d25-b9cb-bc756db11d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:42:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df968c22-6f06-4431-a951-2814a94a46fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:42:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df968c22-6f06-4431-a951-2814a94a46fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-380168999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a187e90d-36dd-426a-8ea9-fcf21b95c6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79753e09cea1404caf03985c332bd23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:42:58Z,use_quota=True,user_id='6e17b21a130f4967a174b56de90c5681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:42:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aab4901-2274-4d7e-9f98-1f60626e4d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:42:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aab4901-2274-4d7e-9f98-1f60626e4d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:42:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f17529-ed65-4612-9a32-5ebb4ae41fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:42:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f17529-ed65-4612-9a32-5ebb4ae41fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a187e90d-36dd-426a-8ea9-fcf21b95c6da', 'volume_name': 'volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:42:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9fc982-76cb-4bc4-ba44-760606738f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:42:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9fc982-76cb-4bc4-ba44-760606738f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:42:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f967eb-f872-4d4a-8720-ac45b757e708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:42:58 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Volume a187e90d-36dd-426a-8ea9-fcf21b95c6da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da', 'volume_size': 1}
Jun 18 11:42:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:42:58 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77 1073741824" returned: 0 in 1.082s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:58 devstack sudo[107259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77
Jun 18 11:42:58 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:59 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root
Jun 18 11:42:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77" returned: 0 in 0.741s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:42:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:42:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:42:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.449s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:42:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-380168999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a187e90d-36dd-426a-8ea9-fcf21b95c6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79753e09cea1404caf03985c332bd23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:42:58Z,use_quota=True,user_id='6e17b21a130f4967a174b56de90c5681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:42:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Creating volume a187e90d-36dd-426a-8ea9-fcf21b95c6da {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:42:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:42:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:42:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:42:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:42:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:42:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:42:59 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:42:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:42:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3d50da-2fe9-4553-80a6-bbf781fb3e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:42:59 devstack sudo[107271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da 1073741824
Jun 18 11:42:59 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:42:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28e8f775-acd6-47a1-ac25-79fd9b42208b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:42:59 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Volume volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77 (3987a53f-cb7a-4869-8aab-bdeb8e923f77): created successfully
Jun 18 11:42:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28e8f775-acd6-47a1-ac25-79fd9b42208b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:42:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Flow 'volume_create_manager' (ba3658ae-fa85-44b9-aa42-cb7d2700cd7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:42:59 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-cf34cd6f-fa25-4b3d-afdf-141b23fa61c0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Created volume successfully.
Jun 18 11:43:00 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root
Jun 18 11:43:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da 1073741824" returned: 0 in 0.978s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:43:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:43:00 devstack sudo[107304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da
Jun 18 11:43:00 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:43:01 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root
Jun 18 11:43:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da" returned: 0 in 0.727s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:43:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:43:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:43:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f967eb-f872-4d4a-8720-ac45b757e708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:43:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab672323-734c-43a3-bf6c-0cafb1d36f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:43:01 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Volume volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da (a187e90d-36dd-426a-8ea9-fcf21b95c6da): created successfully
Jun 18 11:43:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab672323-734c-43a3-bf6c-0cafb1d36f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:43:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Flow 'volume_create_manager' (67cbdaaa-b4c8-4d25-b9cb-bc756db11d9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:43:01 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-c9174bdf-67df-4265-8bb2-6e57727405ea tempest-TestServerVolumeAttachmentScenario-2016600546 None] Created volume successfully.
Jun 18 11:43:04 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-b4849d51-84de-4956-b98d-4cb081203388 req-6e0ba39f-0d40-4187-b2cf-832a0b3c0443 tempest-TestShelveInstance-576764930 None] Terminate volume connection completed successfully.
Jun 18 11:43:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-b4849d51-84de-4956-b98d-4cb081203388 req-6e0ba39f-0d40-4187-b2cf-832a0b3c0443 tempest-TestShelveInstance-576764930 None] Deleting attachment 8361a10d-329e-4bd8-9dd9-d2d03d2f9494. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:43:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-499ee946-341c-4a49-8ae0-6ada0bc0aa95 req-6a454ff6-ba64-4c5d-9a42-dc2a6bc7e73f tempest-TestShelveInstance-576764930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:43:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-499ee946-341c-4a49-8ae0-6ada0bc0aa95 req-6a454ff6-ba64-4c5d-9a42-dc2a6bc7e73f tempest-TestShelveInstance-576764930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:43:09 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba738b11-d5a5-4292-8436-eaf9c45e840a]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:43:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-499ee946-341c-4a49-8ae0-6ada0bc0aa95 req-6a454ff6-ba64-4c5d-9a42-dc2a6bc7e73f tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:43:09 devstack sudo[107351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa
Jun 18 11:43:09 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:43:10 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root
Jun 18 11:43:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-499ee946-341c-4a49-8ae0-6ada0bc0aa95 req-6a454ff6-ba64-4c5d-9a42-dc2a6bc7e73f tempest-TestShelveInstance-576764930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa" returned: 0 in 0.754s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:43:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-499ee946-341c-4a49-8ae0-6ada0bc0aa95 req-6a454ff6-ba64-4c5d-9a42-dc2a6bc7e73f tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:43:10 devstack sudo[107356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa
Jun 18 11:43:10 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:43:10 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root
Jun 18 11:43:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-499ee946-341c-4a49-8ae0-6ada0bc0aa95 req-6a454ff6-ba64-4c5d-9a42-dc2a6bc7e73f tempest-TestShelveInstance-576764930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa" returned: 1 in 0.755s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:43:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-499ee946-341c-4a49-8ae0-6ada0bc0aa95 req-6a454ff6-ba64-4c5d-9a42-dc2a6bc7e73f tempest-TestShelveInstance-576764930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:43:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-499ee946-341c-4a49-8ae0-6ada0bc0aa95 req-6a454ff6-ba64-4c5d-9a42-dc2a6bc7e73f tempest-TestShelveInstance-576764930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.555s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:43:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-499ee946-341c-4a49-8ae0-6ada0bc0aa95 req-6a454ff6-ba64-4c5d-9a42-dc2a6bc7e73f tempest-TestShelveInstance-576764930 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c67e99d9-d7d8-48cb-b624-00d296301a35', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:43:10 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-499ee946-341c-4a49-8ae0-6ada0bc0aa95 req-6a454ff6-ba64-4c5d-9a42-dc2a6bc7e73f tempest-TestShelveInstance-576764930 None] attachment_update completed successfully.
Jun 18 11:43:20 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:UPDATE=9,cinder:SELECT=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:43:20 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:43:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:43:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:43:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:43:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:43:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:43:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:43:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:43:25 devstack sudo[107921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:43:25 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:43:26 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root
Jun 18 11:43:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.680s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:43:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:43:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:43:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:43:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:43:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-652757fe-5612-46c7-99cd-1ed1e138d845 req-3022b911-db24-4e32-b613-d582844fed24 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:43:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-652757fe-5612-46c7-99cd-1ed1e138d845 req-3022b911-db24-4e32-b613-d582844fed24 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:43:40 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d8c920-4c5a-4a80-a84a-8426d8572ef7]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:43:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-652757fe-5612-46c7-99cd-1ed1e138d845 req-3022b911-db24-4e32-b613-d582844fed24 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:43:40 devstack sudo[108003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77
Jun 18 11:43:40 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:43:41 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root
Jun 18 11:43:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-652757fe-5612-46c7-99cd-1ed1e138d845 req-3022b911-db24-4e32-b613-d582844fed24 tempest-TestServerVolumeAttachmentScenario-2016600546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77" returned: 0 in 0.746s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:43:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-652757fe-5612-46c7-99cd-1ed1e138d845 req-3022b911-db24-4e32-b613-d582844fed24 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.764s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:43:41 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-652757fe-5612-46c7-99cd-1ed1e138d845 req-3022b911-db24-4e32-b613-d582844fed24 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b970ee42-8d2b-4dc8-b812-52382b4401f7', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:43:41 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-652757fe-5612-46c7-99cd-1ed1e138d845 req-3022b911-db24-4e32-b613-d582844fed24 tempest-TestServerVolumeAttachmentScenario-2016600546 None] attachment_update completed successfully.
Jun 18 11:43:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-100e322c-fef1-4915-a2f6-183ca376eaa1 req-b789e662-d732-4ba9-8a79-55b40c8cc711 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:43:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-100e322c-fef1-4915-a2f6-183ca376eaa1 req-b789e662-d732-4ba9-8a79-55b40c8cc711 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:43:50 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e26dad-ca14-4ddf-b352-60d0a5abfdff]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:43:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-100e322c-fef1-4915-a2f6-183ca376eaa1 req-b789e662-d732-4ba9-8a79-55b40c8cc711 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:43:50 devstack sudo[108067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da
Jun 18 11:43:50 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:43:50 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root
Jun 18 11:43:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-100e322c-fef1-4915-a2f6-183ca376eaa1 req-b789e662-d732-4ba9-8a79-55b40c8cc711 tempest-TestServerVolumeAttachmentScenario-2016600546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da" returned: 0 in 0.754s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:43:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-100e322c-fef1-4915-a2f6-183ca376eaa1 req-b789e662-d732-4ba9-8a79-55b40c8cc711 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.770s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:43:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-100e322c-fef1-4915-a2f6-183ca376eaa1 req-b789e662-d732-4ba9-8a79-55b40c8cc711 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb3bc85c-8ab0-49be-85a1-aba2ef6cd0fb', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:43:50 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-100e322c-fef1-4915-a2f6-183ca376eaa1 req-b789e662-d732-4ba9-8a79-55b40c8cc711 tempest-TestServerVolumeAttachmentScenario-2016600546 None] attachment_update completed successfully.
Jun 18 11:43:51 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-4e8bae58-a1a7-4c50-bf2c-b7d4a3d7b8d6 tempest-TestShelveInstance-576764930 None] Terminate volume connection completed successfully.
Jun 18 11:43:51 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-4e8bae58-a1a7-4c50-bf2c-b7d4a3d7b8d6 tempest-TestShelveInstance-576764930 None] Deleting attachment c67e99d9-d7d8-48cb-b624-00d296301a35. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:43:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Acquiring lock "cinder-4ee9e3b2-6393-4499-9c4e-efa35607c3aa-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:43:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Lock "cinder-4ee9e3b2-6393-4499-9c4e-efa35607c3aa-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:43:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Acquiring lock "cinder-quobyte-4ee9e3b2-6393-4499-9c4e-efa35607c3aa" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:43:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Lock "cinder-quobyte-4ee9e3b2-6393-4499-9c4e-efa35607c3aa" acquired by "delete_volume" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:43:51 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[f279cd34-ac93-4e05-a5be-ccc2ee5194be]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:43:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:43:51 devstack sudo[108074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa
Jun 18 11:43:51 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:43:52 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root
Jun 18 11:43:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa" returned: 0 in 0.779s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:43:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:43:52 devstack sudo[108078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa
Jun 18 11:43:52 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:43:53 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root
Jun 18 11:43:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa" returned: 1 in 0.750s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:43:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:43:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:43:53 devstack sudo[108083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa
Jun 18 11:43:53 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:43:53 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root
Jun 18 11:43:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ee9e3b2-6393-4499-9c4e-efa35607c3aa" returned: 0 in 0.688s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:43:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Lock "cinder-quobyte-4ee9e3b2-6393-4499-9c4e-efa35607c3aa" released by "delete_volume" :: held 2.290s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:43:54 devstack cinder-volume[91663]: DEBUG cinder.quota [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Created reservations ['a973e3a3-e4f4-43c3-a227-20756d987eca', '2f993f62-f157-491c-956e-8a94bee5f8ae', '8965ebc6-1393-4552-9077-17227a564412', 'd562f85b-475f-4e0d-bbc6-df768632ccd3'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:43:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:43:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:43:54 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:43:54 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:43:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:43:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:43:54 devstack sudo[108087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:43:54 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:43:54 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root
Jun 18 11:43:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.666s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:43:54 devstack cinder-volume[91663]: DEBUG cinder.manager [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:43:54 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Deleted volume successfully.
Jun 18 11:43:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [req-b3c78fad-db4b-4957-b45c-be2abbd81e7d req-1c5cf5d0-4a33-4525-9610-1629271f4209 tempest-TestShelveInstance-576764930 None] Lock "cinder-4ee9e3b2-6393-4499-9c4e-efa35607c3aa-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:43:57 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-525b4929-8a4f-4e62-b4e4-b80e6a595eaf req-12720966-8e63-409b-b9bb-023aaf72ca51 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Terminate volume connection completed successfully.
Jun 18 11:43:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-525b4929-8a4f-4e62-b4e4-b80e6a595eaf req-12720966-8e63-409b-b9bb-023aaf72ca51 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Deleting attachment eb3bc85c-8ab0-49be-85a1-aba2ef6cd0fb. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:44:00 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-a199ff38-10a2-42a1-abfe-3f8f49ecc5ed req-09ae32cd-07be-41fb-a17c-01bbb27d0b1c tempest-TestServerVolumeAttachmentScenario-2016600546 None] Terminate volume connection completed successfully.
Jun 18 11:44:00 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-a199ff38-10a2-42a1-abfe-3f8f49ecc5ed req-09ae32cd-07be-41fb-a17c-01bbb27d0b1c tempest-TestServerVolumeAttachmentScenario-2016600546 None] Deleting attachment b970ee42-8d2b-4dc8-b812-52382b4401f7. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Flow 'volume_create_manager' (f563f7c0-ed32-4860-8754-714a8a67e117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65b3a9f-cd3a-4f52-a730-23114be47b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65b3a9f-cd3a-4f52-a730-23114be47b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1351790789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f04f59-12fc-4385-bd69-c22f764bd44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7cc9b1a4f3479aa951c0ea3cd0bb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:06Z,use_quota=True,user_id='be3b5f9cd4654daba48e8056e2ea6bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7aac46-228e-4f7b-9367-c92d17c7dd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7aac46-228e-4f7b-9367-c92d17c7dd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb7ff4c-e1f7-4408-9722-cd8a229beff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb7ff4c-e1f7-4408-9722-cd8a229beff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f04f59-12fc-4385-bd69-c22f764bd44a', 'volume_name': 'volume-c0f04f59-12fc-4385-bd69-c22f764bd44a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18555f4a-3142-4747-854c-888308269370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18555f4a-3142-4747-854c-888308269370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d81cce-158b-495d-87d3-943491f2485e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:05 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Volume c0f04f59-12fc-4385-bd69-c22f764bd44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f04f59-12fc-4385-bd69-c22f764bd44a', 'volume_size': 1}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1351790789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f04f59-12fc-4385-bd69-c22f764bd44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7cc9b1a4f3479aa951c0ea3cd0bb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:06Z,use_quota=True,user_id='be3b5f9cd4654daba48e8056e2ea6bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Creating volume c0f04f59-12fc-4385-bd69-c22f764bd44a {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:44:05 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:44:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c0f04f59-12fc-4385-bd69-c22f764bd44a 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:05 devstack sudo[108152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c0f04f59-12fc-4385-bd69-c22f764bd44a 1073741824
Jun 18 11:44:05 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Flow 'volume_create_manager' (6205989c-1bfc-4325-83b9-90e0333541e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847db7b0-d680-45d9-b65d-2d133478d37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847db7b0-d680-45d9-b65d-2d133478d37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-685346100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba9c5d23-2788-4f93-9905-75c5d2246c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7cc9b1a4f3479aa951c0ea3cd0bb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:06Z,use_quota=True,user_id='be3b5f9cd4654daba48e8056e2ea6bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864b58c3-61a8-4f22-96f6-95221aa29d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864b58c3-61a8-4f22-96f6-95221aa29d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778dce03-9298-425a-8e2b-7a1f3127558b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778dce03-9298-425a-8e2b-7a1f3127558b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba9c5d23-2788-4f93-9905-75c5d2246c57', 'volume_name': 'volume-ba9c5d23-2788-4f93-9905-75c5d2246c57', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17df97e0-a283-4838-aa71-9a4e7476c4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17df97e0-a283-4838-aa71-9a4e7476c4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77e9d27-889b-4250-9d7c-81e6d9f5310e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:06 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Volume ba9c5d23-2788-4f93-9905-75c5d2246c57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba9c5d23-2788-4f93-9905-75c5d2246c57', 'volume_size': 1}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Flow 'volume_create_manager' (960eefc5-6c71-454c-ab75-03ed90850fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df43d5d8-c1e8-42bd-b222-3c09bbd19d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df43d5d8-c1e8-42bd-b222-3c09bbd19d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1438849901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec86370-8619-4c05-8254-28ec211e9418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7cc9b1a4f3479aa951c0ea3cd0bb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:07Z,use_quota=True,user_id='be3b5f9cd4654daba48e8056e2ea6bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491e487e-b984-4d15-bb66-5f2502840ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491e487e-b984-4d15-bb66-5f2502840ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ab9f41-74ac-4edb-a225-9651cbff5044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ab9f41-74ac-4edb-a225-9651cbff5044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eec86370-8619-4c05-8254-28ec211e9418', 'volume_name': 'volume-eec86370-8619-4c05-8254-28ec211e9418', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1225d32f-8e3c-4e68-a221-585170c30a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1225d32f-8e3c-4e68-a221-585170c30a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5485aa9-3b23-424e-9465-74ed772a5919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:06 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Volume eec86370-8619-4c05-8254-28ec211e9418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eec86370-8619-4c05-8254-28ec211e9418', 'volume_size': 1}
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:06 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c0f04f59-12fc-4385-bd69-c22f764bd44a 1073741824" returned: 0 in 1.173s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Flow 'volume_create_manager' (92f43779-8f4e-4792-9612-79c04b6986d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77803efe-d033-41b3-80ca-b5bbbcfeff82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c0f04f59-12fc-4385-bd69-c22f764bd44a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77803efe-d033-41b3-80ca-b5bbbcfeff82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-798071475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d685ea03-b09b-4a06-95fb-036caaf89887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7cc9b1a4f3479aa951c0ea3cd0bb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:07Z,use_quota=True,user_id='be3b5f9cd4654daba48e8056e2ea6bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a002f835-d5a8-495b-b085-bfb5a5763e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:07 devstack sudo[108165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c0f04f59-12fc-4385-bd69-c22f764bd44a
Jun 18 11:44:07 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a002f835-d5a8-495b-b085-bfb5a5763e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cab6b2c-8302-4a99-9ea4-8c78356cfa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cab6b2c-8302-4a99-9ea4-8c78356cfa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd685ea03-b09b-4a06-95fb-036caaf89887', 'volume_name': 'volume-d685ea03-b09b-4a06-95fb-036caaf89887', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498e41db-f3d8-486e-960d-c60ffe41ef29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498e41db-f3d8-486e-960d-c60ffe41ef29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa93bdb-0819-4bab-8939-da404db850c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:07 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Volume d685ea03-b09b-4a06-95fb-036caaf89887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d685ea03-b09b-4a06-95fb-036caaf89887', 'volume_size': 1}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Flow 'volume_create_manager' (a7fe22b0-27df-4c79-9a13-89560d9406c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924e0f0e-d5fb-425b-85fc-de4a541ec94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924e0f0e-d5fb-425b-85fc-de4a541ec94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1657505981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228dde82-9d5a-496c-9cb1-1f4d0c559f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7cc9b1a4f3479aa951c0ea3cd0bb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:07Z,use_quota=True,user_id='be3b5f9cd4654daba48e8056e2ea6bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc83ac3-dfee-4a43-9c54-02d261abf74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc83ac3-dfee-4a43-9c54-02d261abf74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b873143-f056-4598-9840-607760f69793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b873143-f056-4598-9840-607760f69793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '228dde82-9d5a-496c-9cb1-1f4d0c559f66', 'volume_name': 'volume-228dde82-9d5a-496c-9cb1-1f4d0c559f66', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31eb4ed1-025b-4f11-a756-4f1a72004f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31eb4ed1-025b-4f11-a756-4f1a72004f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfda22d7-abdb-4df5-8a15-1f16a4d1f2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:07 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Volume 228dde82-9d5a-496c-9cb1-1f4d0c559f66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-228dde82-9d5a-496c-9cb1-1f4d0c559f66', 'volume_size': 1}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:07 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c0f04f59-12fc-4385-bd69-c22f764bd44a" returned: 0 in 0.686s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.571s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-685346100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba9c5d23-2788-4f93-9905-75c5d2246c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7cc9b1a4f3479aa951c0ea3cd0bb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:06Z,use_quota=True,user_id='be3b5f9cd4654daba48e8056e2ea6bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Creating volume ba9c5d23-2788-4f93-9905-75c5d2246c57 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:44:07 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba9c5d23-2788-4f93-9905-75c5d2246c57 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d81cce-158b-495d-87d3-943491f2485e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f04f59-12fc-4385-bd69-c22f764bd44a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:07 devstack sudo[108168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba9c5d23-2788-4f93-9905-75c5d2246c57 1073741824
Jun 18 11:44:07 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08b38cc-168c-4d19-a9e6-6035fdec8613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:07 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Volume volume-c0f04f59-12fc-4385-bd69-c22f764bd44a (c0f04f59-12fc-4385-bd69-c22f764bd44a): created successfully
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08b38cc-168c-4d19-a9e6-6035fdec8613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Flow 'volume_create_manager' (f563f7c0-ed32-4860-8754-714a8a67e117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:07 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-e273a25c-d6db-432c-9d87-670921d590e8 tempest-CreateVolumesFromImageTest-593652799 None] Created volume successfully.
Jun 18 11:44:08 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba9c5d23-2788-4f93-9905-75c5d2246c57 1073741824" returned: 0 in 0.821s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba9c5d23-2788-4f93-9905-75c5d2246c57 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:08 devstack sudo[108174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba9c5d23-2788-4f93-9905-75c5d2246c57
Jun 18 11:44:08 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:09 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba9c5d23-2788-4f93-9905-75c5d2246c57" returned: 0 in 0.646s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:44:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.565s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1438849901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec86370-8619-4c05-8254-28ec211e9418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7cc9b1a4f3479aa951c0ea3cd0bb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:07Z,use_quota=True,user_id='be3b5f9cd4654daba48e8056e2ea6bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:44:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Creating volume eec86370-8619-4c05-8254-28ec211e9418 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:44:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:44:09 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:44:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-eec86370-8619-4c05-8254-28ec211e9418 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77e9d27-889b-4250-9d7c-81e6d9f5310e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba9c5d23-2788-4f93-9905-75c5d2246c57', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb69b47f-9e50-4831-b961-27348c3bdc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:09 devstack sudo[108177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-eec86370-8619-4c05-8254-28ec211e9418 1073741824
Jun 18 11:44:09 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:09 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Volume volume-ba9c5d23-2788-4f93-9905-75c5d2246c57 (ba9c5d23-2788-4f93-9905-75c5d2246c57): created successfully
Jun 18 11:44:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb69b47f-9e50-4831-b961-27348c3bdc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Flow 'volume_create_manager' (6205989c-1bfc-4325-83b9-90e0333541e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:09 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-6c61de4b-f8ed-4de2-b53c-416a6f287bc7 tempest-CreateVolumesFromImageTest-593652799 None] Created volume successfully.
Jun 18 11:44:10 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-eec86370-8619-4c05-8254-28ec211e9418 1073741824" returned: 0 in 0.817s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-eec86370-8619-4c05-8254-28ec211e9418 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:10 devstack sudo[108184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-eec86370-8619-4c05-8254-28ec211e9418
Jun 18 11:44:10 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:10 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-eec86370-8619-4c05-8254-28ec211e9418" returned: 0 in 0.662s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.673s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-798071475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d685ea03-b09b-4a06-95fb-036caaf89887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7cc9b1a4f3479aa951c0ea3cd0bb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:07Z,use_quota=True,user_id='be3b5f9cd4654daba48e8056e2ea6bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Creating volume d685ea03-b09b-4a06-95fb-036caaf89887 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:44:10 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d685ea03-b09b-4a06-95fb-036caaf89887 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5485aa9-3b23-424e-9465-74ed772a5919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eec86370-8619-4c05-8254-28ec211e9418', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:10 devstack sudo[108187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d685ea03-b09b-4a06-95fb-036caaf89887 1073741824
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d1f1f5-2b9e-44cb-aeb1-c2a2f6bfdb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:10 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:10 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Volume volume-eec86370-8619-4c05-8254-28ec211e9418 (eec86370-8619-4c05-8254-28ec211e9418): created successfully
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d1f1f5-2b9e-44cb-aeb1-c2a2f6bfdb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Flow 'volume_create_manager' (960eefc5-6c71-454c-ab75-03ed90850fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:10 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-7e5bca75-6236-482c-9efa-a6363c0a7b77 tempest-CreateVolumesFromImageTest-593652799 None] Created volume successfully.
Jun 18 11:44:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Acquiring lock "cinder-a187e90d-36dd-426a-8ea9-fcf21b95c6da-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "cinder-a187e90d-36dd-426a-8ea9-fcf21b95c6da-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Acquiring lock "cinder-quobyte-a187e90d-36dd-426a-8ea9-fcf21b95c6da" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "cinder-quobyte-a187e90d-36dd-426a-8ea9-fcf21b95c6da" acquired by "delete_volume" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:11 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb7ecbf-765c-47a1-b80c-36465bdd35d3]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:44:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:11 devstack sudo[108193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da
Jun 18 11:44:11 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:11 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d685ea03-b09b-4a06-95fb-036caaf89887 1073741824" returned: 0 in 0.894s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d685ea03-b09b-4a06-95fb-036caaf89887 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:11 devstack sudo[108195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d685ea03-b09b-4a06-95fb-036caaf89887
Jun 18 11:44:11 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:12 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da" returned: 0 in 0.740s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:12 devstack sudo[108201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da
Jun 18 11:44:12 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:12 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d685ea03-b09b-4a06-95fb-036caaf89887" returned: 0 in 0.633s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.934s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1657505981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228dde82-9d5a-496c-9cb1-1f4d0c559f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7cc9b1a4f3479aa951c0ea3cd0bb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:07Z,use_quota=True,user_id='be3b5f9cd4654daba48e8056e2ea6bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Creating volume 228dde82-9d5a-496c-9cb1-1f4d0c559f66 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:44:12 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-228dde82-9d5a-496c-9cb1-1f4d0c559f66 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa93bdb-0819-4bab-8939-da404db850c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d685ea03-b09b-4a06-95fb-036caaf89887', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:12 devstack sudo[108203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-228dde82-9d5a-496c-9cb1-1f4d0c559f66 1073741824
Jun 18 11:44:12 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ca3ea6-163e-4159-a84a-78d767d022cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:12 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Volume volume-d685ea03-b09b-4a06-95fb-036caaf89887 (d685ea03-b09b-4a06-95fb-036caaf89887): created successfully
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ca3ea6-163e-4159-a84a-78d767d022cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Flow 'volume_create_manager' (92f43779-8f4e-4792-9612-79c04b6986d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:12 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-19eca381-8aa5-4846-804e-36f1793525b4 tempest-CreateVolumesFromImageTest-593652799 None] Created volume successfully.
Jun 18 11:44:12 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a187e90d-36dd-426a-8ea9-fcf21b95c6da" returned: 0 in 0.638s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "cinder-quobyte-a187e90d-36dd-426a-8ea9-fcf21b95c6da" released by "delete_volume" :: held 1.416s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Created reservations ['2aaf7999-4dc7-438f-af32-af96417020a2', '045a1702-b09f-47e5-bfdd-8671978385d2', 'bb10ed28-8412-401a-bef1-b21002969efa', '3d6b9565-285b-4cc0-a8f1-6fd78e41556a'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:13 devstack sudo[108210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:44:13 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:13 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-228dde82-9d5a-496c-9cb1-1f4d0c559f66 1073741824" returned: 0 in 0.820s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-228dde82-9d5a-496c-9cb1-1f4d0c559f66 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:13 devstack sudo[108212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-228dde82-9d5a-496c-9cb1-1f4d0c559f66
Jun 18 11:44:13 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Acquiring lock "cinder-3987a53f-cb7a-4869-8aab-bdeb8e923f77-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "cinder-3987a53f-cb7a-4869-8aab-bdeb8e923f77-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:13 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.666s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:44:13 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Deleted volume successfully.
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Acquiring lock "cinder-quobyte-3987a53f-cb7a-4869-8aab-bdeb8e923f77" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7166e633-30fb-4081-92c7-b70bd5c68720 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "cinder-a187e90d-36dd-426a-8ea9-fcf21b95c6da-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "cinder-quobyte-3987a53f-cb7a-4869-8aab-bdeb8e923f77" acquired by "delete_volume" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda099bf-2cf6-4208-a2c4-d28efdb079f5]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:13 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-228dde82-9d5a-496c-9cb1-1f4d0c559f66" returned: 0 in 0.656s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfda22d7-abdb-4df5-8a15-1f16a4d1f2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-228dde82-9d5a-496c-9cb1-1f4d0c559f66', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df176fd-a3b7-49c5-a24c-7b95a45a84c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:13 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Volume volume-228dde82-9d5a-496c-9cb1-1f4d0c559f66 (228dde82-9d5a-496c-9cb1-1f4d0c559f66): created successfully
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df176fd-a3b7-49c5-a24c-7b95a45a84c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Flow 'volume_create_manager' (a7fe22b0-27df-4c79-9a13-89560d9406c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:13 devstack sudo[108216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77
Jun 18 11:44:13 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-fdf6f180-fa86-48e8-946b-59995ff0e53e tempest-CreateVolumesFromImageTest-593652799 None] Created volume successfully.
Jun 18 11:44:13 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:14 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77" returned: 0 in 0.745s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:14 devstack sudo[108221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77
Jun 18 11:44:14 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "cinder-228dde82-9d5a-496c-9cb1-1f4d0c559f66-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-228dde82-9d5a-496c-9cb1-1f4d0c559f66-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "cinder-quobyte-228dde82-9d5a-496c-9cb1-1f4d0c559f66" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-quobyte-228dde82-9d5a-496c-9cb1-1f4d0c559f66" acquired by "delete_volume" :: waited 0.029s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:15 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55b03e6-0dad-4e4a-a9ba-7395a84cda15]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:44:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-228dde82-9d5a-496c-9cb1-1f4d0c559f66 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:15 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3987a53f-cb7a-4869-8aab-bdeb8e923f77" returned: 0 in 0.637s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:15 devstack sudo[108224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-228dde82-9d5a-496c-9cb1-1f4d0c559f66
Jun 18 11:44:15 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "cinder-quobyte-3987a53f-cb7a-4869-8aab-bdeb8e923f77" released by "delete_volume" :: held 1.430s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:15 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Created reservations ['ab4c7c85-11a3-4caa-acf1-629e67b0adc8', 'f2522196-0a3f-48ce-a968-00cee74e5818', '1b08100d-9b9b-46a6-b3c2-5eb4252ca4ac', 'd9acd90f-36f5-4c06-826f-555037b4056d'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:44:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:15 devstack sudo[108226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:44:15 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:15 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-228dde82-9d5a-496c-9cb1-1f4d0c559f66" returned: 0 in 0.768s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-228dde82-9d5a-496c-9cb1-1f4d0c559f66 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:15 devstack sudo[108232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-228dde82-9d5a-496c-9cb1-1f4d0c559f66
Jun 18 11:44:15 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:16 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.668s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:16 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:44:16 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Deleted volume successfully.
Jun 18 11:44:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-0b10dd23-5e0f-41c1-a74d-8607b783fab0 tempest-TestServerVolumeAttachmentScenario-2016600546 None] Lock "cinder-3987a53f-cb7a-4869-8aab-bdeb8e923f77-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:16 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-228dde82-9d5a-496c-9cb1-1f4d0c559f66" returned: 0 in 0.708s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-quobyte-228dde82-9d5a-496c-9cb1-1f4d0c559f66" released by "delete_volume" :: held 1.516s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:16 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] Created reservations ['782e9c2f-39f3-448c-b099-041b4f79d7d5', '54a0afd1-54b0-4c29-907c-d26e5f5d0b2e', '266b16b3-eadf-40a0-8af2-54093af63c0d', 'd21eeff2-1f54-4d61-a7c7-26fc9a16dab8'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:44:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:16 devstack sudo[108235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:44:16 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "cinder-d685ea03-b09b-4a06-95fb-036caaf89887-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-d685ea03-b09b-4a06-95fb-036caaf89887-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "cinder-quobyte-d685ea03-b09b-4a06-95fb-036caaf89887" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-quobyte-d685ea03-b09b-4a06-95fb-036caaf89887" acquired by "delete_volume" :: waited 0.018s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:17 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de82ae0-1d48-48c9-9163-46f37ce917d7]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:44:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d685ea03-b09b-4a06-95fb-036caaf89887 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:17 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.673s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:17 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:44:17 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] Deleted volume successfully.
Jun 18 11:44:17 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e6d0541a-48cf-4c0d-8023-09fff039cd04 tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-228dde82-9d5a-496c-9cb1-1f4d0c559f66-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:17 devstack sudo[108238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d685ea03-b09b-4a06-95fb-036caaf89887
Jun 18 11:44:17 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:18 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d685ea03-b09b-4a06-95fb-036caaf89887" returned: 0 in 0.794s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d685ea03-b09b-4a06-95fb-036caaf89887 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:18 devstack sudo[108244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d685ea03-b09b-4a06-95fb-036caaf89887
Jun 18 11:44:18 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:18 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-d685ea03-b09b-4a06-95fb-036caaf89887" returned: 0 in 0.661s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-quobyte-d685ea03-b09b-4a06-95fb-036caaf89887" released by "delete_volume" :: held 1.498s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:18 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] Created reservations ['8998606e-a927-4023-b55b-3df10e3a30ca', '2101f172-67e4-4b7d-ad3e-03e63c69be55', 'ffae5316-1ce7-49a9-9ffc-e2bd2ba884b3', '92fa50cf-a677-49e5-a60d-98678ff85b01'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:44:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:19 devstack sudo[108247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:44:19 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "cinder-eec86370-8619-4c05-8254-28ec211e9418-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-eec86370-8619-4c05-8254-28ec211e9418-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "cinder-quobyte-eec86370-8619-4c05-8254-28ec211e9418" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-quobyte-eec86370-8619-4c05-8254-28ec211e9418" acquired by "delete_volume" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:19 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[745d9edc-2507-42ef-90d9-c977c8acd648]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:44:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-eec86370-8619-4c05-8254-28ec211e9418 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:19 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.799s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:19 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:44:19 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] Deleted volume successfully.
Jun 18 11:44:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-78f936b9-a7d2-42d3-b97d-6e62ac2f07d7 tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-d685ea03-b09b-4a06-95fb-036caaf89887-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:19 devstack sudo[108250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-eec86370-8619-4c05-8254-28ec211e9418
Jun 18 11:44:19 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:20 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-eec86370-8619-4c05-8254-28ec211e9418" returned: 0 in 0.863s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-eec86370-8619-4c05-8254-28ec211e9418 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:20 devstack sudo[108257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-eec86370-8619-4c05-8254-28ec211e9418
Jun 18 11:44:20 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:21 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-eec86370-8619-4c05-8254-28ec211e9418" returned: 0 in 0.655s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-quobyte-eec86370-8619-4c05-8254-28ec211e9418" released by "delete_volume" :: held 1.568s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:21 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] Created reservations ['a9ad5aef-94de-4cd5-885b-722f3b05b522', '29262388-3b95-498b-9cd9-810ff4df486c', '93a14bed-77be-4167-a7bc-f6a769901272', 'f4954c60-5d9f-4482-8829-64d394246e1c'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:44:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:21 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:21 devstack sudo[108260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:44:21 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "cinder-ba9c5d23-2788-4f93-9905-75c5d2246c57-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-ba9c5d23-2788-4f93-9905-75c5d2246c57-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "cinder-quobyte-ba9c5d23-2788-4f93-9905-75c5d2246c57" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-quobyte-ba9c5d23-2788-4f93-9905-75c5d2246c57" acquired by "delete_volume" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:22 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ba3add-4f4a-48c8-a6c8-9cd038ca4619]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:44:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba9c5d23-2788-4f93-9905-75c5d2246c57 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:22 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.727s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:22 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:44:22 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] Deleted volume successfully.
Jun 18 11:44:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3e28bf98-1cb1-4b5e-8fc6-31400be837d0 tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-eec86370-8619-4c05-8254-28ec211e9418-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:22 devstack sudo[108264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba9c5d23-2788-4f93-9905-75c5d2246c57
Jun 18 11:44:22 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:22 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba9c5d23-2788-4f93-9905-75c5d2246c57" returned: 0 in 0.812s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba9c5d23-2788-4f93-9905-75c5d2246c57 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:22 devstack sudo[108269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba9c5d23-2788-4f93-9905-75c5d2246c57
Jun 18 11:44:22 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:23 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-ba9c5d23-2788-4f93-9905-75c5d2246c57" returned: 0 in 0.686s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-quobyte-ba9c5d23-2788-4f93-9905-75c5d2246c57" released by "delete_volume" :: held 1.557s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:23 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] Created reservations ['afdedd7a-47c7-4fd0-a86d-8017ac0ce7b4', '39f3a930-da3b-49c5-89b1-bc23e55e47f9', '28f2bc64-aa3e-484b-b77e-acd031f436d0', '2831c2fc-7669-49cb-a294-737acb38aaa1'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:44:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:23 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:23 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:23 devstack sudo[108272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:44:23 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "cinder-c0f04f59-12fc-4385-bd69-c22f764bd44a-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-c0f04f59-12fc-4385-bd69-c22f764bd44a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "cinder-quobyte-c0f04f59-12fc-4385-bd69-c22f764bd44a" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-quobyte-c0f04f59-12fc-4385-bd69-c22f764bd44a" acquired by "delete_volume" :: waited 0.028s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:24 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bce7e32-8017-4b73-9f17-28f957906e12]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:44:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c0f04f59-12fc-4385-bd69-c22f764bd44a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:24 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.693s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:24 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:44:24 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] Deleted volume successfully.
Jun 18 11:44:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e2d61f1b-3926-4b0f-9894-9e8188abb885 tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-ba9c5d23-2788-4f93-9905-75c5d2246c57-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:24 devstack sudo[108276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c0f04f59-12fc-4385-bd69-c22f764bd44a
Jun 18 11:44:24 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:25 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c0f04f59-12fc-4385-bd69-c22f764bd44a" returned: 0 in 0.867s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c0f04f59-12fc-4385-bd69-c22f764bd44a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:25 devstack sudo[108317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c0f04f59-12fc-4385-bd69-c22f764bd44a
Jun 18 11:44:25 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:44:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:25 devstack sudo[108319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:44:25 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:25 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-c0f04f59-12fc-4385-bd69-c22f764bd44a" returned: 0 in 0.691s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-quobyte-c0f04f59-12fc-4385-bd69-c22f764bd44a" released by "delete_volume" :: held 1.605s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:25 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] Created reservations ['2c424796-8edb-4c5a-8f72-18f0bb937578', 'f281e5cb-3ba4-4c21-9d15-9be783b3d4fb', 'c1152fb9-8517-46ec-bbce-e936a392532a', '77c2269e-ef2d-4257-91b8-70cce8e9b4b8'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:44:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:26 devstack sudo[108323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:44:26 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:26 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.676s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:44:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:44:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:44:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:44:26 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.681s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:44:26 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] Deleted volume successfully.
Jun 18 11:44:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-bbfd4895-533d-4f35-af35-781207ec116c tempest-CreateVolumesFromImageTest-593652799 None] Lock "cinder-c0f04f59-12fc-4385-bd69-c22f764bd44a-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Flow 'volume_create_manager' (ef60b632-8297-4a47-9e11-e33617eaf9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b85045-1bc9-45a8-8019-86d306aba2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b85045-1bc9-45a8-8019-86d306aba2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2059451103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259310e2-9c44-4872-ac65-b1fa73c34629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7113acf2654042c1afc8b0ab94f4a30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:29Z,use_quota=True,user_id='4ff67389c22c4e689b3e170a3805518f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee966037-2beb-4cc7-a246-eab2f8d251f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee966037-2beb-4cc7-a246-eab2f8d251f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11903a2a-530b-4726-9ae8-7bb64fa2ab86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11903a2a-530b-4726-9ae8-7bb64fa2ab86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '259310e2-9c44-4872-ac65-b1fa73c34629', 'volume_name': 'volume-259310e2-9c44-4872-ac65-b1fa73c34629', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6b4ce6-3ad2-48ed-979e-adb3f93b156e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6b4ce6-3ad2-48ed-979e-adb3f93b156e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c49f7b-b8a7-4e3f-a8ec-35c44d88de40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:29 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume 259310e2-9c44-4872-ac65-b1fa73c34629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-259310e2-9c44-4872-ac65-b1fa73c34629', 'volume_size': 1}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2059451103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259310e2-9c44-4872-ac65-b1fa73c34629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7113acf2654042c1afc8b0ab94f4a30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:29Z,use_quota=True,user_id='4ff67389c22c4e689b3e170a3805518f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Creating volume 259310e2-9c44-4872-ac65-b1fa73c34629 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:44:29 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:44:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:29 devstack sudo[108326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629 1073741824
Jun 18 11:44:29 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:30 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629 1073741824" returned: 0 in 0.892s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:30 devstack sudo[108333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629
Jun 18 11:44:30 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:30 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629" returned: 0 in 0.647s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:30 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:44:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:30 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=71,cinder:UPDATE=81,cinder:INSERT=22,cinder:DELETE=7 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:44:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c49f7b-b8a7-4e3f-a8ec-35c44d88de40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-259310e2-9c44-4872-ac65-b1fa73c34629', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97c6bd8-a060-48cb-8853-b6b43e88ce08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:30 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=62,cinder:UPDATE=89,cinder:INSERT=16,cinder:DELETE=6 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:44:31 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume volume-259310e2-9c44-4872-ac65-b1fa73c34629 (259310e2-9c44-4872-ac65-b1fa73c34629): created successfully
Jun 18 11:44:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97c6bd8-a060-48cb-8853-b6b43e88ce08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Flow 'volume_create_manager' (ef60b632-8297-4a47-9e11-e33617eaf9e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:31 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-3e996b31-8df6-4b34-8749-ddac9c48d6bf tempest-CreateVolumesFromSnapshotTest-1770444033 None] Created volume successfully.
Jun 18 11:44:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:31 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Creating offline snapshot 2df7d237-963f-471b-a31e-c2c18a428a02 of volume 259310e2-9c44-4872-ac65-b1fa73c34629 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:44:31 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b0a8b5-32ce-4cd6-ac8c-01cd358f7f03]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:44:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:31 devstack sudo[108336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629
Jun 18 11:44:31 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:32 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629" returned: 0 in 0.779s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:32 devstack sudo[108341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02 1G
Jun 18 11:44:32 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:33 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02 1G" returned: 0 in 0.845s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-259310e2-9c44-4872-ac65-b1fa73c34629 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:33 devstack sudo[108347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-259310e2-9c44-4872-ac65-b1fa73c34629 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02
Jun 18 11:44:33 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:34 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-259310e2-9c44-4872-ac65-b1fa73c34629 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02" returned: 0 in 0.744s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:34 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02 is being set with open permissions: ugo+rw
Jun 18 11:44:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:34 devstack sudo[108352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02
Jun 18 11:44:34 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:34 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02" returned: 0 in 0.675s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:34 devstack sudo[108355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.info
Jun 18 11:44:34 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:35 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.info" returned: 0 in 0.655s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:35 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.info is being set with open permissions: ugo+rw
Jun 18 11:44:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:35 devstack sudo[108358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.info
Jun 18 11:44:35 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:36 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.info" returned: 0 in 0.663s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.478s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:36 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-cfb895cc-3e77-4400-985f-f9b7a5bf31b0 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Create snapshot completed successfully
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Flow 'volume_create_manager' (6cdae2c4-d175-4ec7-8a69-801d9bf3e1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c32017-2b8d-4dbd-8ad5-95c624a95eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c32017-2b8d-4dbd-8ad5-95c624a95eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-834076971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ceee562-2235-4e78-84f3-193af88fd5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7113acf2654042c1afc8b0ab94f4a30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:37Z,use_quota=True,user_id='4ff67389c22c4e689b3e170a3805518f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e899267-374e-46ff-b225-2c4854f66318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e899267-374e-46ff-b225-2c4854f66318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19b5bd4-9650-40ee-9e65-5c225eb4a409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19b5bd4-9650-40ee-9e65-5c225eb4a409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ceee562-2235-4e78-84f3-193af88fd5e7', 'volume_name': 'volume-3ceee562-2235-4e78-84f3-193af88fd5e7', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f67ab73-2e0d-4b19-aea0-4c4430f13756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f67ab73-2e0d-4b19-aea0-4c4430f13756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5abbede6-767c-4d72-aaea-ad5098e7c85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:37 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume 3ceee562-2235-4e78-84f3-193af88fd5e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ceee562-2235-4e78-84f3-193af88fd5e7', 'volume_size': 1}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-834076971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ceee562-2235-4e78-84f3-193af88fd5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7113acf2654042c1afc8b0ab94f4a30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:37Z,use_quota=True,user_id='4ff67389c22c4e689b3e170a3805518f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Creating volume 3ceee562-2235-4e78-84f3-193af88fd5e7 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:44:37 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:44:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3ceee562-2235-4e78-84f3-193af88fd5e7 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:37 devstack sudo[108362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3ceee562-2235-4e78-84f3-193af88fd5e7 1073741824
Jun 18 11:44:37 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Flow 'volume_create_manager' (8e4dcfcd-6e80-4389-b1ba-b8577c8b1063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8dc51d-852a-4097-bf8e-832f693d26b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8dc51d-852a-4097-bf8e-832f693d26b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1016482279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5922de0e-65a1-4ddd-a663-3943f6a38ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7113acf2654042c1afc8b0ab94f4a30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:38Z,use_quota=True,user_id='4ff67389c22c4e689b3e170a3805518f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719b237b-9902-4c0a-996e-3bb2ad2ee852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719b237b-9902-4c0a-996e-3bb2ad2ee852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c94e1b0-38e8-4287-bcc9-096b465359d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c94e1b0-38e8-4287-bcc9-096b465359d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5922de0e-65a1-4ddd-a663-3943f6a38ca7', 'volume_name': 'volume-5922de0e-65a1-4ddd-a663-3943f6a38ca7', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9a392b-e926-4202-995f-6b50db174fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9a392b-e926-4202-995f-6b50db174fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7886dee-6a10-418b-8cce-2c5dff1cd1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:38 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume 5922de0e-65a1-4ddd-a663-3943f6a38ca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5922de0e-65a1-4ddd-a663-3943f6a38ca7', 'volume_size': 1}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Flow 'volume_create_manager' (73e3d833-6b0e-48b2-bed9-ad2871db085d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44da3557-b6c5-47f3-bd12-4b3e98443d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44da3557-b6c5-47f3-bd12-4b3e98443d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-345552497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4730b737-e178-422c-9216-b0795e8bb951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7113acf2654042c1afc8b0ab94f4a30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:38Z,use_quota=True,user_id='4ff67389c22c4e689b3e170a3805518f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efaf8c2f-6b33-454d-b236-f4c5c6a8ffcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efaf8c2f-6b33-454d-b236-f4c5c6a8ffcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb034a34-e4bc-469e-9b72-c522938a5c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb034a34-e4bc-469e-9b72-c522938a5c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4730b737-e178-422c-9216-b0795e8bb951', 'volume_name': 'volume-4730b737-e178-422c-9216-b0795e8bb951', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d5fe11-7b1e-40e1-a6d4-c22041fa90d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d5fe11-7b1e-40e1-a6d4-c22041fa90d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2148afef-3635-47f4-bb19-a420d8a1a5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:38 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume 4730b737-e178-422c-9216-b0795e8bb951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4730b737-e178-422c-9216-b0795e8bb951', 'volume_size': 1}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:38 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3ceee562-2235-4e78-84f3-193af88fd5e7 1073741824" returned: 0 in 1.116s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3ceee562-2235-4e78-84f3-193af88fd5e7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:38 devstack sudo[108370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3ceee562-2235-4e78-84f3-193af88fd5e7
Jun 18 11:44:38 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Flow 'volume_create_manager' (41f05dc0-c833-4022-86f9-2428722e1fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98bdb83-bf55-4e0a-bb4f-9cf6c6645de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98bdb83-bf55-4e0a-bb4f-9cf6c6645de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1557878831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327d7cea-37b6-4bc4-a428-9eea64c9d22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7113acf2654042c1afc8b0ab94f4a30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:39Z,use_quota=True,user_id='4ff67389c22c4e689b3e170a3805518f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ff6db7-1445-4cb2-b3b3-98ad394aac32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ff6db7-1445-4cb2-b3b3-98ad394aac32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87c4c58a-febc-4869-a165-1e3e6fd0a303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87c4c58a-febc-4869-a165-1e3e6fd0a303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '327d7cea-37b6-4bc4-a428-9eea64c9d22a', 'volume_name': 'volume-327d7cea-37b6-4bc4-a428-9eea64c9d22a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7dcade-8524-4338-805c-ad432cbd274e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7dcade-8524-4338-805c-ad432cbd274e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6802f58-c77c-416a-942d-52320ea0713a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:38 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume 327d7cea-37b6-4bc4-a428-9eea64c9d22a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-327d7cea-37b6-4bc4-a428-9eea64c9d22a', 'volume_size': 1}
Jun 18 11:44:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Flow 'volume_create_manager' (adf3b151-f69c-4b2e-8f3f-0bf3257c2083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948546e8-53c4-462b-8ab9-fcb23980a558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948546e8-53c4-462b-8ab9-fcb23980a558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1986274411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a226cd3b-8587-4bfb-a659-72af6ac611a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7113acf2654042c1afc8b0ab94f4a30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:39Z,use_quota=True,user_id='4ff67389c22c4e689b3e170a3805518f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5d9204-275e-4291-a816-c9a0934436be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5d9204-275e-4291-a816-c9a0934436be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138b022a-d873-409a-8a91-99a226e8e497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138b022a-d873-409a-8a91-99a226e8e497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a226cd3b-8587-4bfb-a659-72af6ac611a1', 'volume_name': 'volume-a226cd3b-8587-4bfb-a659-72af6ac611a1', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846f73ee-8a89-4f13-ad8c-5e315ff6e359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846f73ee-8a89-4f13-ad8c-5e315ff6e359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85239642-7acf-499f-8db8-5cba34a99f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:39 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume a226cd3b-8587-4bfb-a659-72af6ac611a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a226cd3b-8587-4bfb-a659-72af6ac611a1', 'volume_size': 1}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:39 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3ceee562-2235-4e78-84f3-193af88fd5e7" returned: 0 in 0.749s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.317s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1016482279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5922de0e-65a1-4ddd-a663-3943f6a38ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7113acf2654042c1afc8b0ab94f4a30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:38Z,use_quota=True,user_id='4ff67389c22c4e689b3e170a3805518f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Creating volume 5922de0e-65a1-4ddd-a663-3943f6a38ca7 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:44:39 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5922de0e-65a1-4ddd-a663-3943f6a38ca7 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5abbede6-767c-4d72-aaea-ad5098e7c85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ceee562-2235-4e78-84f3-193af88fd5e7', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:39 devstack sudo[108373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5922de0e-65a1-4ddd-a663-3943f6a38ca7 1073741824
Jun 18 11:44:39 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d043f258-1008-47bf-8dcb-a795f5e51db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:39 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume volume-3ceee562-2235-4e78-84f3-193af88fd5e7 (3ceee562-2235-4e78-84f3-193af88fd5e7): created successfully
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d043f258-1008-47bf-8dcb-a795f5e51db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:39 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Flow 'volume_create_manager' (6cdae2c4-d175-4ec7-8a69-801d9bf3e1ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:39 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-69f1f4df-42ef-4981-b42f-f4a478c630c1 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Created volume successfully.
Jun 18 11:44:40 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5922de0e-65a1-4ddd-a663-3943f6a38ca7 1073741824" returned: 0 in 0.873s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5922de0e-65a1-4ddd-a663-3943f6a38ca7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:40 devstack sudo[108379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5922de0e-65a1-4ddd-a663-3943f6a38ca7
Jun 18 11:44:40 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:41 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5922de0e-65a1-4ddd-a663-3943f6a38ca7" returned: 0 in 0.628s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.666s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-345552497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4730b737-e178-422c-9216-b0795e8bb951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7113acf2654042c1afc8b0ab94f4a30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:38Z,use_quota=True,user_id='4ff67389c22c4e689b3e170a3805518f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Creating volume 4730b737-e178-422c-9216-b0795e8bb951 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:44:41 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4730b737-e178-422c-9216-b0795e8bb951 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7886dee-6a10-418b-8cce-2c5dff1cd1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5922de0e-65a1-4ddd-a663-3943f6a38ca7', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:41 devstack sudo[108382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4730b737-e178-422c-9216-b0795e8bb951 1073741824
Jun 18 11:44:41 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e286995a-53e8-4163-b9e9-4d2826a88ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:41 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume volume-5922de0e-65a1-4ddd-a663-3943f6a38ca7 (5922de0e-65a1-4ddd-a663-3943f6a38ca7): created successfully
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e286995a-53e8-4163-b9e9-4d2826a88ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Flow 'volume_create_manager' (8e4dcfcd-6e80-4389-b1ba-b8577c8b1063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:41 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-af47ca33-17f8-4b59-a916-52f8b1d4601b tempest-CreateVolumesFromSnapshotTest-1770444033 None] Created volume successfully.
Jun 18 11:44:41 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4730b737-e178-422c-9216-b0795e8bb951 1073741824" returned: 0 in 0.953s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4730b737-e178-422c-9216-b0795e8bb951 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:42 devstack sudo[108387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4730b737-e178-422c-9216-b0795e8bb951
Jun 18 11:44:42 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:42 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4730b737-e178-422c-9216-b0795e8bb951" returned: 0 in 0.698s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.837s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1557878831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327d7cea-37b6-4bc4-a428-9eea64c9d22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7113acf2654042c1afc8b0ab94f4a30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:39Z,use_quota=True,user_id='4ff67389c22c4e689b3e170a3805518f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Creating volume 327d7cea-37b6-4bc4-a428-9eea64c9d22a {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:44:42 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-327d7cea-37b6-4bc4-a428-9eea64c9d22a 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:42 devstack sudo[108390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-327d7cea-37b6-4bc4-a428-9eea64c9d22a 1073741824
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2148afef-3635-47f4-bb19-a420d8a1a5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4730b737-e178-422c-9216-b0795e8bb951', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:42 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5383c8d0-193a-48d1-9234-d2570bf109cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:42 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume volume-4730b737-e178-422c-9216-b0795e8bb951 (4730b737-e178-422c-9216-b0795e8bb951): created successfully
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5383c8d0-193a-48d1-9234-d2570bf109cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Flow 'volume_create_manager' (73e3d833-6b0e-48b2-bed9-ad2871db085d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:42 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-66016488-1070-402c-b651-d68e34af2b57 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Created volume successfully.
Jun 18 11:44:43 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-327d7cea-37b6-4bc4-a428-9eea64c9d22a 1073741824" returned: 0 in 0.998s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-327d7cea-37b6-4bc4-a428-9eea64c9d22a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:43 devstack sudo[108395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-327d7cea-37b6-4bc4-a428-9eea64c9d22a
Jun 18 11:44:43 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:44 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-327d7cea-37b6-4bc4-a428-9eea64c9d22a" returned: 0 in 0.659s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:44:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.201s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1986274411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a226cd3b-8587-4bfb-a659-72af6ac611a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7113acf2654042c1afc8b0ab94f4a30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:39Z,use_quota=True,user_id='4ff67389c22c4e689b3e170a3805518f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:44:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Creating volume a226cd3b-8587-4bfb-a659-72af6ac611a1 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:44:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:44:44 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:44:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a226cd3b-8587-4bfb-a659-72af6ac611a1 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6802f58-c77c-416a-942d-52320ea0713a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-327d7cea-37b6-4bc4-a428-9eea64c9d22a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7317c228-53f5-43c2-8d29-268b5c831ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:44 devstack sudo[108398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a226cd3b-8587-4bfb-a659-72af6ac611a1 1073741824
Jun 18 11:44:44 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:44 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume volume-327d7cea-37b6-4bc4-a428-9eea64c9d22a (327d7cea-37b6-4bc4-a428-9eea64c9d22a): created successfully
Jun 18 11:44:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7317c228-53f5-43c2-8d29-268b5c831ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Flow 'volume_create_manager' (41f05dc0-c833-4022-86f9-2428722e1fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:44 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-675a30f7-9fa9-48fb-a24d-dce41f9e5993 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Created volume successfully.
Jun 18 11:44:45 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a226cd3b-8587-4bfb-a659-72af6ac611a1 1073741824" returned: 0 in 0.911s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a226cd3b-8587-4bfb-a659-72af6ac611a1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:45 devstack sudo[108404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a226cd3b-8587-4bfb-a659-72af6ac611a1
Jun 18 11:44:45 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:46 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a226cd3b-8587-4bfb-a659-72af6ac611a1" returned: 0 in 0.674s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:44:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85239642-7acf-499f-8db8-5cba34a99f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a226cd3b-8587-4bfb-a659-72af6ac611a1', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc05d7d-75e8-4633-8025-200f728ec9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:46 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Volume volume-a226cd3b-8587-4bfb-a659-72af6ac611a1 (a226cd3b-8587-4bfb-a659-72af6ac611a1): created successfully
Jun 18 11:44:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc05d7d-75e8-4633-8025-200f728ec9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Flow 'volume_create_manager' (adf3b151-f69c-4b2e-8f3f-0bf3257c2083) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:46 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-a4227af3-17d6-4184-bb64-da1a20809b43 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Created volume successfully.
Jun 18 11:44:46 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "cinder-a226cd3b-8587-4bfb-a659-72af6ac611a1-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:46 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-a226cd3b-8587-4bfb-a659-72af6ac611a1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:46 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "cinder-quobyte-a226cd3b-8587-4bfb-a659-72af6ac611a1" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-quobyte-a226cd3b-8587-4bfb-a659-72af6ac611a1" acquired by "delete_volume" :: waited 0.035s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:47 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[057e4282-cd56-4da7-9b2f-d02a7008797f]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:44:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a226cd3b-8587-4bfb-a659-72af6ac611a1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:47 devstack sudo[108408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a226cd3b-8587-4bfb-a659-72af6ac611a1
Jun 18 11:44:47 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:47 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a226cd3b-8587-4bfb-a659-72af6ac611a1" returned: 0 in 0.833s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a226cd3b-8587-4bfb-a659-72af6ac611a1 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:47 devstack sudo[108413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a226cd3b-8587-4bfb-a659-72af6ac611a1
Jun 18 11:44:47 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:48 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a226cd3b-8587-4bfb-a659-72af6ac611a1" returned: 0 in 0.643s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:48 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-quobyte-a226cd3b-8587-4bfb-a659-72af6ac611a1" released by "delete_volume" :: held 1.540s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:48 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] Created reservations ['a7e026ee-b52f-4e20-88e5-af9a856660e9', 'cffacee6-2513-4d7d-ac40-e16093e76aea', '0b476d14-ad5e-4a42-b6d4-cf5fab8e7113', '9aaf855a-ef06-4739-b2cf-8413032d18ba'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:44:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:48 devstack sudo[108416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:44:48 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:49 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "cinder-327d7cea-37b6-4bc4-a428-9eea64c9d22a-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:49 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-327d7cea-37b6-4bc4-a428-9eea64c9d22a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:49 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "cinder-quobyte-327d7cea-37b6-4bc4-a428-9eea64c9d22a" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:49 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-quobyte-327d7cea-37b6-4bc4-a428-9eea64c9d22a" acquired by "delete_volume" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:49 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[25904101-1938-4480-8d49-dddcb2994d8d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:44:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-327d7cea-37b6-4bc4-a428-9eea64c9d22a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:49 devstack sudo[108418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-327d7cea-37b6-4bc4-a428-9eea64c9d22a
Jun 18 11:44:49 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:49 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.793s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:49 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:44:49 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] Deleted volume successfully.
Jun 18 11:44:49 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c9a5d934-af71-4114-89ed-dbd9557404da tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-a226cd3b-8587-4bfb-a659-72af6ac611a1-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:50 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-327d7cea-37b6-4bc4-a428-9eea64c9d22a" returned: 0 in 0.794s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-327d7cea-37b6-4bc4-a428-9eea64c9d22a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:50 devstack sudo[108426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-327d7cea-37b6-4bc4-a428-9eea64c9d22a
Jun 18 11:44:50 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:50 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-327d7cea-37b6-4bc4-a428-9eea64c9d22a" returned: 0 in 0.701s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:50 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-quobyte-327d7cea-37b6-4bc4-a428-9eea64c9d22a" released by "delete_volume" :: held 1.547s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:50 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] Created reservations ['81b99a24-076a-4a04-bf49-68049bd59d83', '087767d8-5b53-48f1-815e-dfab44254729', '35483c74-84b3-4d4d-a129-3d2792456458', 'a6bf4bf9-d419-45d1-b469-8c9a55838258'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:44:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:50 devstack sudo[108429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:44:50 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "cinder-4730b737-e178-422c-9216-b0795e8bb951-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-4730b737-e178-422c-9216-b0795e8bb951-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "cinder-quobyte-4730b737-e178-422c-9216-b0795e8bb951" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-quobyte-4730b737-e178-422c-9216-b0795e8bb951" acquired by "delete_volume" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:51 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c560b8-4c02-40f3-8733-c2e4229fe31d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:44:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4730b737-e178-422c-9216-b0795e8bb951 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:51 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.680s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:51 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:44:51 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] Deleted volume successfully.
Jun 18 11:44:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-3105bf19-d20b-4b81-8f63-c94f54724dfd tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-327d7cea-37b6-4bc4-a428-9eea64c9d22a-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:51 devstack sudo[108432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4730b737-e178-422c-9216-b0795e8bb951
Jun 18 11:44:51 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Flow 'volume_create_manager' (efe43772-029b-487f-b231-2adae69ea4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b2d29d-69c4-4025-9b1e-a10c1fd08ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b2d29d-69c4-4025-9b1e-a10c1fd08ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-730659501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba596cf21ef04e83bc7c0a51fea2c1ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:52Z,use_quota=True,user_id='c60b497d3d4a418a98a77c2c4a008d37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f753c249-05cf-4998-9f63-18bbcf64996e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f753c249-05cf-4998-9f63-18bbcf64996e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8238e953-7b72-4ae2-adc8-8068d7be3405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8238e953-7b72-4ae2-adc8-8068d7be3405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4', 'volume_name': 'volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8bd521a-5a71-4a6d-9c5a-5ba0dcf491fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8bd521a-5a71-4a6d-9c5a-5ba0dcf491fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb103924-c493-46f5-b647-f38fa4a910c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:52 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Volume 7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4', 'volume_size': 1}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-730659501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba596cf21ef04e83bc7c0a51fea2c1ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:44:52Z,use_quota=True,user_id='c60b497d3d4a418a98a77c2c4a008d37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Creating volume 7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:44:52 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:52 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4730b737-e178-422c-9216-b0795e8bb951" returned: 0 in 0.817s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4730b737-e178-422c-9216-b0795e8bb951 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:52 devstack sudo[108437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 1073741824
Jun 18 11:44:52 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:52 devstack sudo[108439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4730b737-e178-422c-9216-b0795e8bb951
Jun 18 11:44:52 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:53 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4730b737-e178-422c-9216-b0795e8bb951" returned: 0 in 0.705s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-quobyte-4730b737-e178-422c-9216-b0795e8bb951" released by "delete_volume" :: held 1.573s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Created reservations ['56cbde73-e238-42ce-9dc8-c1291385d101', '2fe58ccd-df45-4314-b9cb-1d409cf889d3', '7ca71654-b2e7-49d0-b200-404198c4ec1b', '38046c28-8c40-4333-8b7d-46a176989067'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:53 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 1073741824" returned: 0 in 0.924s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:53 devstack sudo[108448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:44:53 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:53 devstack sudo[108450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4
Jun 18 11:44:53 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "cinder-5922de0e-65a1-4ddd-a663-3943f6a38ca7-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-5922de0e-65a1-4ddd-a663-3943f6a38ca7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "cinder-quobyte-5922de0e-65a1-4ddd-a663-3943f6a38ca7" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-quobyte-5922de0e-65a1-4ddd-a663-3943f6a38ca7" acquired by "delete_volume" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[869ac475-50ca-497e-9df9-99510fce83fd]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5922de0e-65a1-4ddd-a663-3943f6a38ca7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:53 devstack sudo[108452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5922de0e-65a1-4ddd-a663-3943f6a38ca7
Jun 18 11:44:53 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:53 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.774s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:53 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:44:53 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Deleted volume successfully.
Jun 18 11:44:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-be7e551c-aad2-4ad8-8097-0109cc370252 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-4730b737-e178-422c-9216-b0795e8bb951-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:54 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4" returned: 0 in 0.748s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:54 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:44:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:54 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb103924-c493-46f5-b647-f38fa4a910c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:54 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cecdce-ac42-4b0d-b457-3fd4f647516a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:44:54 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Volume volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 (7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4): created successfully
Jun 18 11:44:54 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cecdce-ac42-4b0d-b457-3fd4f647516a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:44:54 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Flow 'volume_create_manager' (efe43772-029b-487f-b231-2adae69ea4f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:44:54 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-97cdb223-e501-469d-98d1-a4597dcee1a2 tempest-TestStampPattern-6799463 None] Created volume successfully.
Jun 18 11:44:54 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5922de0e-65a1-4ddd-a663-3943f6a38ca7" returned: 0 in 0.842s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5922de0e-65a1-4ddd-a663-3943f6a38ca7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:54 devstack sudo[108461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5922de0e-65a1-4ddd-a663-3943f6a38ca7
Jun 18 11:44:54 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:55 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-5922de0e-65a1-4ddd-a663-3943f6a38ca7" returned: 0 in 0.640s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-quobyte-5922de0e-65a1-4ddd-a663-3943f6a38ca7" released by "delete_volume" :: held 1.527s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:55 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Created reservations ['f392318f-d066-442e-b78b-97d2012fad62', '55d1cb35-c630-46ef-85a5-19962f56444c', '79564f1e-4a6f-4518-b6ad-5abad94a6739', 'c6536ea1-61ad-4c04-8281-8ab8d6de3066'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:44:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:55 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:55 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:55 devstack sudo[108464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:44:55 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "cinder-3ceee562-2235-4e78-84f3-193af88fd5e7-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-3ceee562-2235-4e78-84f3-193af88fd5e7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "cinder-quobyte-3ceee562-2235-4e78-84f3-193af88fd5e7" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:56 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-quobyte-3ceee562-2235-4e78-84f3-193af88fd5e7" acquired by "delete_volume" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:56 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae07b02f-ee42-46e2-bbd0-b9ec8a9118eb]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:44:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3ceee562-2235-4e78-84f3-193af88fd5e7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:56 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.653s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:56 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:44:56 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Deleted volume successfully.
Jun 18 11:44:56 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-226e56b6-8577-42af-8930-71c6b7e19463 tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-5922de0e-65a1-4ddd-a663-3943f6a38ca7-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:56 devstack sudo[108467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3ceee562-2235-4e78-84f3-193af88fd5e7
Jun 18 11:44:56 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:56 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3ceee562-2235-4e78-84f3-193af88fd5e7" returned: 0 in 0.753s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3ceee562-2235-4e78-84f3-193af88fd5e7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:56 devstack sudo[108472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3ceee562-2235-4e78-84f3-193af88fd5e7
Jun 18 11:44:56 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:57 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3ceee562-2235-4e78-84f3-193af88fd5e7" returned: 0 in 0.653s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-quobyte-3ceee562-2235-4e78-84f3-193af88fd5e7" released by "delete_volume" :: held 1.448s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:57 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] Created reservations ['8f1892d4-9622-44e2-b85f-c28c4692ae19', '15aa52cb-a04c-4226-b219-30819da2fa50', 'fe618ca4-d70a-41cd-aabe-f4239b860468', '6e403ec9-d0de-4fd4-9304-370efd581cea'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:44:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:44:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:44:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:44:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:44:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:44:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:57 devstack sudo[108475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:44:57 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "cinder-2df7d237-963f-471b-a31e-c2c18a428a02-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-2df7d237-963f-471b-a31e-c2c18a428a02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "cinder-quobyte-259310e2-9c44-4872-ac65-b1fa73c34629" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-quobyte-259310e2-9c44-4872-ac65-b1fa73c34629" acquired by "delete_snapshot" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "cinder-quobyte-2df7d237-963f-471b-a31e-c2c18a428a02" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:44:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-quobyte-2df7d237-963f-471b-a31e-c2c18a428a02" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:44:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] Deleting offline snapshot 2df7d237-963f-471b-a31e-c2c18a428a02 of volume 259310e2-9c44-4872-ac65-b1fa73c34629 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:44:58 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] snapshot_file for this snap is: volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:44:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.665s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:58 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:44:58 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] Deleted volume successfully.
Jun 18 11:44:58 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e18c27-ac7e-460e-8428-601a0f773165]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:44:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:58 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-9a35d948-dfc4-4e9c-bfff-9728eb152d9f tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-3ceee562-2235-4e78-84f3-193af88fd5e7-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:44:58 devstack sudo[108478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02
Jun 18 11:44:58 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:58 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02" returned: 0 in 0.744s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:58 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-259310e2-9c44-4872-ac65-b1fa73c34629(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:44:59 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedc4797-a974-4a92-ab68-c55f2d5a499c]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:44:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:59 devstack sudo[108483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629
Jun 18 11:44:59 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:44:59 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root
Jun 18 11:44:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629" returned: 0 in 0.774s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:44:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:44:59 devstack sudo[108488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02
Jun 18 11:44:59 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:00 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02" returned: 0 in 0.868s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:00 devstack sudo[108495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02
Jun 18 11:45:00 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:01 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629.2df7d237-963f-471b-a31e-c2c18a428a02" returned: 0 in 0.686s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:01 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-quobyte-2df7d237-963f-471b-a31e-c2c18a428a02" released by "_delete_snapshot" :: held 3.210s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:45:01 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-quobyte-259310e2-9c44-4872-ac65-b1fa73c34629" released by "delete_snapshot" :: held 3.236s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:45:01 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] Created reservations ['21fd8e65-dc19-4d05-94cb-bf4492626105', '7ec38b10-2ec8-486e-b2fe-6bb76104851d', '7e0d6046-e166-4c9b-afb9-79ee7f421971', 'cf086459-8d6f-4aea-9652-35bafa66fde5'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:45:01 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] Delete snapshot completed successfully.
Jun 18 11:45:01 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-cdf669ad-1f02-46b9-8626-bbb912536f9c tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-2df7d237-963f-471b-a31e-c2c18a428a02-delete_snapshot" released by "delete_snapshot" :: held 3.416s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:45:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "cinder-259310e2-9c44-4872-ac65-b1fa73c34629-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:45:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-259310e2-9c44-4872-ac65-b1fa73c34629-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:45:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "cinder-quobyte-259310e2-9c44-4872-ac65-b1fa73c34629" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:45:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-quobyte-259310e2-9c44-4872-ac65-b1fa73c34629" acquired by "delete_volume" :: waited 0.023s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:45:02 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c867bc-4548-4173-93c5-0fc0674b6f64]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:45:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:02 devstack sudo[108517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629
Jun 18 11:45:02 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:03 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629" returned: 0 in 0.757s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:03 devstack sudo[108524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629
Jun 18 11:45:03 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:03 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-259310e2-9c44-4872-ac65-b1fa73c34629" returned: 0 in 0.662s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:03 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-quobyte-259310e2-9c44-4872-ac65-b1fa73c34629" released by "delete_volume" :: held 1.502s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:45:04 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] Created reservations ['64ba43fa-34b2-4b71-8a8a-1cb02a420ea1', 'abdd1178-3cdb-462b-9546-e33f2f4b715d', 'c290dc5e-3219-4e56-a2cc-c9acef4d8da1', '56e7a4c9-634c-45c9-96f2-4cc6ce4a0dbc'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:45:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:45:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:45:04 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:45:04 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:45:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:45:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:04 devstack sudo[108527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:45:04 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:04 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.654s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:04 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:45:04 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] Deleted volume successfully.
Jun 18 11:45:04 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-96b4dcaf-3b7f-4c7d-a2ae-7cc564946e8d tempest-CreateVolumesFromSnapshotTest-1770444033 None] Lock "cinder-259310e2-9c44-4872-ac65-b1fa73c34629-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Flow 'volume_create_manager' (1b30b5c9-4d3b-45e3-86c4-9721e5e9bf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0347c982-b4cb-496a-9d85-3680dabf4711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0347c982-b4cb-496a-9d85-3680dabf4711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffcb351-cefa-4099-8f8a-007cc2c06d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aba40a71ae84ac39af450a3abcd5dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:45:08Z,use_quota=True,user_id='985b1954a3c24c96bc5ba035cbeaddf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed82f43-2373-4c83-ab67-ea9f72693595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed82f43-2373-4c83-ab67-ea9f72693595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f4480c-cfd3-4882-8125-51f4f47e95fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f4480c-cfd3-4882-8125-51f4f47e95fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dffcb351-cefa-4099-8f8a-007cc2c06d21', 'volume_name': 'volume-dffcb351-cefa-4099-8f8a-007cc2c06d21', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad618eb-1878-4e80-8e1a-6f21003f9b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad618eb-1878-4e80-8e1a-6f21003f9b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eccc7529-62c9-4b98-b2ab-2086e2568c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:45:07 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Volume dffcb351-cefa-4099-8f8a-007cc2c06d21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dffcb351-cefa-4099-8f8a-007cc2c06d21', 'volume_size': 1}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffcb351-cefa-4099-8f8a-007cc2c06d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aba40a71ae84ac39af450a3abcd5dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:45:08Z,use_quota=True,user_id='985b1954a3c24c96bc5ba035cbeaddf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Creating volume dffcb351-cefa-4099-8f8a-007cc2c06d21 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:45:07 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:45:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dffcb351-cefa-4099-8f8a-007cc2c06d21 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:08 devstack sudo[108605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dffcb351-cefa-4099-8f8a-007cc2c06d21 1073741824
Jun 18 11:45:08 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:08 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dffcb351-cefa-4099-8f8a-007cc2c06d21 1073741824" returned: 0 in 0.866s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dffcb351-cefa-4099-8f8a-007cc2c06d21 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:08 devstack sudo[108610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dffcb351-cefa-4099-8f8a-007cc2c06d21
Jun 18 11:45:08 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:09 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dffcb351-cefa-4099-8f8a-007cc2c06d21" returned: 0 in 0.725s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:45:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:45:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eccc7529-62c9-4b98-b2ab-2086e2568c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dffcb351-cefa-4099-8f8a-007cc2c06d21', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:45:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14e6d6d-0abc-405b-93aa-c98ad77c1a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:45:09 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Volume volume-dffcb351-cefa-4099-8f8a-007cc2c06d21 (dffcb351-cefa-4099-8f8a-007cc2c06d21): created successfully
Jun 18 11:45:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14e6d6d-0abc-405b-93aa-c98ad77c1a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:45:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Flow 'volume_create_manager' (1b30b5c9-4d3b-45e3-86c4-9721e5e9bf26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:45:09 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-fc7b9006-4213-4645-8973-3ba1731e374c tempest-CinderUnicodeTest-1349467656 None] Created volume successfully.
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Flow 'volume_create_manager' (0e24802c-1f57-4e64-b310-835170c7b3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9022f3c3-1ac9-4075-b0ca-ffac3911010a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9022f3c3-1ac9-4075-b0ca-ffac3911010a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:45:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1016558457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a76e256-b875-4087-b138-f596de77d5b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aba40a71ae84ac39af450a3abcd5dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:45:11Z,use_quota=True,user_id='985b1954a3c24c96bc5ba035cbeaddf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536f19e5-4c76-40fe-900e-031491c8a66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536f19e5-4c76-40fe-900e-031491c8a66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af22cc28-7ce8-4c5c-9bde-646bc9bd5bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af22cc28-7ce8-4c5c-9bde-646bc9bd5bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a76e256-b875-4087-b138-f596de77d5b5', 'volume_name': 'volume-3a76e256-b875-4087-b138-f596de77d5b5', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b662cd-d1bc-43e9-8aa0-15e611cce592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b662cd-d1bc-43e9-8aa0-15e611cce592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1208d1e-fd35-4fa4-992a-16230f5e0f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:45:10 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Volume 3a76e256-b875-4087-b138-f596de77d5b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a76e256-b875-4087-b138-f596de77d5b5', 'volume_size': 1}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:45:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1016558457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a76e256-b875-4087-b138-f596de77d5b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aba40a71ae84ac39af450a3abcd5dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:45:11Z,use_quota=True,user_id='985b1954a3c24c96bc5ba035cbeaddf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Creating volume 3a76e256-b875-4087-b138-f596de77d5b5 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:45:10 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:45:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:10 devstack sudo[108614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5 1073741824
Jun 18 11:45:10 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:11 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5 1073741824" returned: 0 in 0.917s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:11 devstack sudo[108619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5
Jun 18 11:45:11 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:12 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5" returned: 0 in 0.642s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:45:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:45:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1208d1e-fd35-4fa4-992a-16230f5e0f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a76e256-b875-4087-b138-f596de77d5b5', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:45:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2fa581-f094-4f2f-9cde-2704ca8067cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:45:12 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Volume volume-3a76e256-b875-4087-b138-f596de77d5b5 (3a76e256-b875-4087-b138-f596de77d5b5): created successfully
Jun 18 11:45:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2fa581-f094-4f2f-9cde-2704ca8067cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:45:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Flow 'volume_create_manager' (0e24802c-1f57-4e64-b310-835170c7b3e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:45:12 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-e680b6f2-3e6b-4be7-8f29-bf9ad61bfbc4 tempest-CinderUnicodeTest-1349467656 None] Created volume successfully.
Jun 18 11:45:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:45:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:45:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] Creating offline snapshot 400480c1-6c78-496e-b2ec-c158346b0b07 of volume 3a76e256-b875-4087-b138-f596de77d5b5 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:45:13 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a86e258-05cc-4762-ac15-3780c8368901]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:45:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:13 devstack sudo[108624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5
Jun 18 11:45:13 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:13 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5" returned: 0 in 0.790s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:13 devstack sudo[108629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07 1G
Jun 18 11:45:13 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:14 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07 1G" returned: 0 in 0.802s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a76e256-b875-4087-b138-f596de77d5b5 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:14 devstack sudo[108634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a76e256-b875-4087-b138-f596de77d5b5 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07
Jun 18 11:45:14 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:15 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a76e256-b875-4087-b138-f596de77d5b5 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07" returned: 0 in 0.685s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:15 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07 is being set with open permissions: ugo+rw
Jun 18 11:45:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:15 devstack sudo[108639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07
Jun 18 11:45:15 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:16 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07" returned: 0 in 0.632s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:16 devstack sudo[108642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.info
Jun 18 11:45:16 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:16 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.info" returned: 0 in 0.638s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:16 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.info is being set with open permissions: ugo+rw
Jun 18 11:45:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:16 devstack sudo[108645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.info
Jun 18 11:45:16 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:17 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.info" returned: 0 in 0.625s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.275s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:45:17 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-fb2f6196-bb62-4134-9d3f-83d60786d784 tempest-CinderUnicodeTest-1349467656 None] Create snapshot completed successfully
Jun 18 11:45:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] Acquiring lock "cinder-400480c1-6c78-496e-b2ec-c158346b0b07-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:45:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] Lock "cinder-400480c1-6c78-496e-b2ec-c158346b0b07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:45:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] Acquiring lock "cinder-quobyte-3a76e256-b875-4087-b138-f596de77d5b5" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:45:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] Lock "cinder-quobyte-3a76e256-b875-4087-b138-f596de77d5b5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:45:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] Acquiring lock "cinder-quobyte-400480c1-6c78-496e-b2ec-c158346b0b07" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:45:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] Lock "cinder-quobyte-400480c1-6c78-496e-b2ec-c158346b0b07" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:45:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] Deleting offline snapshot 400480c1-6c78-496e-b2ec-c158346b0b07 of volume 3a76e256-b875-4087-b138-f596de77d5b5 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:45:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] snapshot_file for this snap is: volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:45:18 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[828afda0-b7a1-4610-aca9-10414badef38]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:45:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:18 devstack sudo[108648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07
Jun 18 11:45:18 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:19 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07" returned: 0 in 0.795s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:19 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a76e256-b875-4087-b138-f596de77d5b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:45:19 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[75aef7c9-17ed-4c31-84d0-1ffa994c5e75]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:45:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:19 devstack sudo[108653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5
Jun 18 11:45:19 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:20 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5" returned: 0 in 0.763s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:20 devstack sudo[108676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07
Jun 18 11:45:20 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:20 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07" returned: 0 in 0.745s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:20 devstack sudo[108681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07
Jun 18 11:45:20 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:21 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5.400480c1-6c78-496e-b2ec-c158346b0b07" returned: 0 in 0.636s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] Lock "cinder-quobyte-400480c1-6c78-496e-b2ec-c158346b0b07" released by "_delete_snapshot" :: held 3.039s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:45:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] Lock "cinder-quobyte-3a76e256-b875-4087-b138-f596de77d5b5" released by "delete_snapshot" :: held 3.065s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:45:21 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] Created reservations ['34bd98e4-efb8-4bbd-8645-19d3b5dd87be', 'ca649114-fd2d-434f-afed-c4d1534433ee', '2a62d50c-3e85-4a73-b506-25a0de375495', '5f9a3877-4df4-4ebb-9c9b-4d9079d13479'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:45:21 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] Delete snapshot completed successfully.
Jun 18 11:45:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7625aa45-73dd-4379-8fb9-96739ae9bae0 tempest-CinderUnicodeTest-1349467656 None] Lock "cinder-400480c1-6c78-496e-b2ec-c158346b0b07-delete_snapshot" released by "delete_snapshot" :: held 3.191s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:45:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] Acquiring lock "cinder-3a76e256-b875-4087-b138-f596de77d5b5-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:45:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] Lock "cinder-3a76e256-b875-4087-b138-f596de77d5b5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:45:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] Acquiring lock "cinder-quobyte-3a76e256-b875-4087-b138-f596de77d5b5" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:45:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] Lock "cinder-quobyte-3a76e256-b875-4087-b138-f596de77d5b5" acquired by "delete_volume" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:45:22 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba1e175-c935-4e06-8d38-2214ccf12b25]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:45:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:22 devstack sudo[108684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5
Jun 18 11:45:22 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:23 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5" returned: 0 in 0.756s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:23 devstack sudo[108689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5
Jun 18 11:45:23 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:24 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3a76e256-b875-4087-b138-f596de77d5b5" returned: 0 in 0.621s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] Lock "cinder-quobyte-3a76e256-b875-4087-b138-f596de77d5b5" released by "delete_volume" :: held 1.437s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] Created reservations ['b00e8c3b-f286-4bf8-80af-8562baea74b1', 'bc29fd35-72b4-41f1-8a73-e4172f22cfce', '74050c33-3361-4aef-987e-bb8c094582fd', '6e5beff4-e7ca-4641-9b01-143139b8a3bd'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:24 devstack sudo[108692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:45:24 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] Acquiring lock "cinder-dffcb351-cefa-4099-8f8a-007cc2c06d21-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:45:24 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.628s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:45:24 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] Deleted volume successfully.
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] Lock "cinder-dffcb351-cefa-4099-8f8a-007cc2c06d21-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-30a17302-455c-467c-b426-6f1242cae721 tempest-CinderUnicodeTest-1349467656 None] Lock "cinder-3a76e256-b875-4087-b138-f596de77d5b5-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] Acquiring lock "cinder-quobyte-dffcb351-cefa-4099-8f8a-007cc2c06d21" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] Lock "cinder-quobyte-dffcb351-cefa-4099-8f8a-007cc2c06d21" acquired by "delete_volume" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebdbdd2-d441-4288-991e-5b4a6502f059]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:45:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dffcb351-cefa-4099-8f8a-007cc2c06d21 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:25 devstack sudo[108729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dffcb351-cefa-4099-8f8a-007cc2c06d21
Jun 18 11:45:25 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:45:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:45:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:45:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:45:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:45:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:45:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:25 devstack sudo[108733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:45:25 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:25 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dffcb351-cefa-4099-8f8a-007cc2c06d21" returned: 0 in 0.759s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dffcb351-cefa-4099-8f8a-007cc2c06d21 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:25 devstack sudo[108738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dffcb351-cefa-4099-8f8a-007cc2c06d21
Jun 18 11:45:25 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:26 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.665s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:45:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:45:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:45:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:45:26 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-dffcb351-cefa-4099-8f8a-007cc2c06d21" returned: 0 in 0.655s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] Lock "cinder-quobyte-dffcb351-cefa-4099-8f8a-007cc2c06d21" released by "delete_volume" :: held 1.461s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:45:26 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] Created reservations ['b2d74a7b-f985-4a5a-8d42-c2eb30fc7adb', 'fa3b05b9-d252-4609-b13e-08d1e99e2d34', '55b22e06-5d97-4749-9f37-2990f639e0b1', '94cb224a-d18b-4be1-86b1-a03640e0ce37'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:45:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:45:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:45:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:45:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:45:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:45:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:26 devstack sudo[108742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:45:26 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:27 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.704s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:27 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:45:27 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] Deleted volume successfully.
Jun 18 11:45:27 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-766edcb4-9ce8-408d-8526-121f4bc5d45b tempest-CinderUnicodeTest-1349467656 None] Lock "cinder-dffcb351-cefa-4099-8f8a-007cc2c06d21-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:45:35 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:UPDATE=100,cinder:DELETE=13,cinder:SELECT=75,cinder:INSERT=24 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:45:35 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:UPDATE=105,cinder:SELECT=75,cinder:INSERT=26,cinder:DELETE=6 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:45:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-689100ee-4b43-418d-8e7f-7969f5138592 req-18c4b37f-3c20-40a4-b799-6fb25d7af9e6 tempest-TestStampPattern-6799463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:45:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-689100ee-4b43-418d-8e7f-7969f5138592 req-18c4b37f-3c20-40a4-b799-6fb25d7af9e6 tempest-TestStampPattern-6799463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:45:35 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ef1f17-dd16-4f65-a191-0bdb20a76405]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:45:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-689100ee-4b43-418d-8e7f-7969f5138592 req-18c4b37f-3c20-40a4-b799-6fb25d7af9e6 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:36 devstack sudo[108761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4
Jun 18 11:45:36 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:36 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-689100ee-4b43-418d-8e7f-7969f5138592 req-18c4b37f-3c20-40a4-b799-6fb25d7af9e6 tempest-TestStampPattern-6799463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4" returned: 0 in 0.752s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-689100ee-4b43-418d-8e7f-7969f5138592 req-18c4b37f-3c20-40a4-b799-6fb25d7af9e6 tempest-TestStampPattern-6799463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.771s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:45:36 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-689100ee-4b43-418d-8e7f-7969f5138592 req-18c4b37f-3c20-40a4-b799-6fb25d7af9e6 tempest-TestStampPattern-6799463 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75c9820f-031f-4b80-b629-60935db74670', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:45:36 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-689100ee-4b43-418d-8e7f-7969f5138592 req-18c4b37f-3c20-40a4-b799-6fb25d7af9e6 tempest-TestStampPattern-6799463 None] attachment_update completed successfully.
Jun 18 11:45:44 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-dfe2e7ad-10d3-46df-935c-099254ac2e46 req-8058c8b0-913e-40a0-980c-2b263c8578b5 tempest-TestStampPattern-6799463 None] Terminate volume connection completed successfully.
Jun 18 11:45:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-dfe2e7ad-10d3-46df-935c-099254ac2e46 req-8058c8b0-913e-40a0-980c-2b263c8578b5 tempest-TestStampPattern-6799463 None] Deleting attachment 75c9820f-031f-4b80-b629-60935db74670. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:45:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:45:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:45:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] Creating offline snapshot b5e55189-04da-4af9-9f15-ab15b6af5457 of volume 7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:45:46 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d2fe1a-d910-4b6a-8a40-21842794651d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:45:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:46 devstack sudo[109200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4
Jun 18 11:45:46 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:47 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4" returned: 0 in 0.762s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:47 devstack sudo[109205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457 1G
Jun 18 11:45:47 devstack sudo[109205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:48 devstack sudo[109205]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457 1G" returned: 0 in 0.774s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:48 devstack sudo[109210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457
Jun 18 11:45:48 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:49 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457" returned: 0 in 0.671s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:49 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457 is being set with open permissions: ugo+rw
Jun 18 11:45:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:49 devstack sudo[109215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457
Jun 18 11:45:49 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:49 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457" returned: 0 in 0.636s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:49 devstack sudo[109218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.info
Jun 18 11:45:49 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:50 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.info" returned: 0 in 0.654s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:50 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.info is being set with open permissions: ugo+rw
Jun 18 11:45:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:45:50 devstack sudo[109222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.info
Jun 18 11:45:50 devstack sudo[109222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:45:50 devstack sudo[109222]: pam_unix(sudo:session): session closed for user root
Jun 18 11:45:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.info" returned: 0 in 0.629s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:45:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.214s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:45:51 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-41d0f674-27e5-4124-b539-e09d9a027b37 tempest-TestStampPattern-6799463 None] Create snapshot completed successfully
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Flow 'volume_create_manager' (14ec7965-a559-47d6-9de4-56eae3f175d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3286ce9d-53f8-4256-86e9-f5f0eed390ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3286ce9d-53f8-4256-86e9-f5f0eed390ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1963612904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79825f67-cea0-4093-b65c-bc8bf8cdaa7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba596cf21ef04e83bc7c0a51fea2c1ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b5e55189-04da-4af9-9f15-ab15b6af5457,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:46:02Z,use_quota=True,user_id='c60b497d3d4a418a98a77c2c4a008d37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dcba231-0f81-46a8-a199-5055c6da9f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dcba231-0f81-46a8-a199-5055c6da9f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a291540-09b9-4a5b-aec6-d52e961fc7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a291540-09b9-4a5b-aec6-d52e961fc7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '79825f67-cea0-4093-b65c-bc8bf8cdaa7f', 'volume_name': 'volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f', 'volume_size': 1, 'snapshot_id': 'b5e55189-04da-4af9-9f15-ab15b6af5457'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22ab84d-1a67-4ba1-9ab2-d329c3f28b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22ab84d-1a67-4ba1-9ab2-d329c3f28b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06cd8dd7-433c-47e1-aabc-644971258386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:46:01 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Volume 79825f67-cea0-4093-b65c-bc8bf8cdaa7f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f', 'volume_size': 1, 'snapshot_id': 'b5e55189-04da-4af9-9f15-ab15b6af5457'}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Acquiring lock "cinder-quobyte-b5e55189-04da-4af9-9f15-ab15b6af5457-79825f67-cea0-4093-b65c-bc8bf8cdaa7f" by "_create_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Lock "cinder-quobyte-b5e55189-04da-4af9-9f15-ab15b6af5457-79825f67-cea0-4093-b65c-bc8bf8cdaa7f" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Creating volume 79825f67-cea0-4093-b65c-bc8bf8cdaa7f from snapshot b5e55189-04da-4af9-9f15-ab15b6af5457 {{(pid=91663) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Acquiring lock "cinder-quobyte-79825f67-cea0-4093-b65c-bc8bf8cdaa7f" by "_copy_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Lock "cinder-quobyte-79825f67-cea0-4093-b65c-bc8bf8cdaa7f" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] snapshot: b5e55189-04da-4af9-9f15-ab15b6af5457, volume: 79825f67-cea0-4093-b65c-bc8bf8cdaa7f,  {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c080b20-961f-4610-8a0d-00c72b66c8b1]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:46:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:46:01 devstack sudo[109267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457
Jun 18 11:46:01 devstack sudo[109267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:46:02 devstack sudo[109267]: pam_unix(sudo:session): session closed for user root
Jun 18 11:46:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457" returned: 0 in 0.775s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:46:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:46:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 18 11:46:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Creating direct copy from snapshot {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 18 11:46:02 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e0640a-f39b-4234-9f9e-f0bacca437a9]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:46:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:46:02 devstack sudo[109275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4
Jun 18 11:46:02 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:46:03 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root
Jun 18 11:46:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4" returned: 0 in 0.801s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:46:03 devstack cinder-volume[91663]: DEBUG cinder.utils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Path /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f not found in is_blk_device check {{(pid=91663) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 18 11:46:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:46:03 devstack sudo[109282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f
Jun 18 11:46:03 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:46:08 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root
Jun 18 11:46:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f" returned: 0 in 4.862s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:46:08 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02d51f6-00a6-45a0-8bca-86755dd8d299]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:46:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:46:08 devstack sudo[109300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4
Jun 18 11:46:08 devstack sudo[109300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:46:09 devstack sudo[109300]: pam_unix(sudo:session): session closed for user root
Jun 18 11:46:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4" returned: 0 in 1.054s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:46:09 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4, size 1024.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:46:09 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Converted 1024.00 MB image at 210.55 MB/s
Jun 18 11:46:09 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f is being set with open permissions: ugo+rw
Jun 18 11:46:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:46:09 devstack sudo[109306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f
Jun 18 11:46:09 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:46:10 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root
Jun 18 11:46:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f" returned: 0 in 0.739s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:46:10 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Lock "cinder-quobyte-79825f67-cea0-4093-b65c-bc8bf8cdaa7f" released by "_copy_volume_from_snapshot" :: held 8.346s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:46:10 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Lock "cinder-quobyte-b5e55189-04da-4af9-9f15-ab15b6af5457-79825f67-cea0-4093-b65c-bc8bf8cdaa7f" released by "_create_volume_from_snapshot" :: held 8.387s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:46:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.404s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:46:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06cd8dd7-433c-47e1-aabc-644971258386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f', 'volume_size': 1, 'snapshot_id': 'b5e55189-04da-4af9-9f15-ab15b6af5457'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:46:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c832e3a-3d79-4097-915a-8f3ed6933c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:46:10 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Volume volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f (79825f67-cea0-4093-b65c-bc8bf8cdaa7f): created successfully
Jun 18 11:46:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c832e3a-3d79-4097-915a-8f3ed6933c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:46:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Flow 'volume_create_manager' (14ec7965-a559-47d6-9de4-56eae3f175d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:46:10 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-655977b5-06ea-435c-8b70-953030b0a5b1 tempest-TestStampPattern-6799463 None] Created volume successfully.
Jun 18 11:46:20 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:46:20 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:46:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:46:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:46:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:46:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:46:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:46:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:46:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:46:25 devstack sudo[109419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:46:25 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:46:26 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root
Jun 18 11:46:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.651s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:46:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:46:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:46:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:46:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:46:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-b0e248c6-127f-41c1-9265-ebcb025ded61 req-47b09498-a4f4-443c-8ea9-b233cfb0adce tempest-TestStampPattern-6799463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:46:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-b0e248c6-127f-41c1-9265-ebcb025ded61 req-47b09498-a4f4-443c-8ea9-b233cfb0adce tempest-TestStampPattern-6799463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:46:58 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[8809363a-d029-42a3-bc24-20162ee3a90b]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:46:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-b0e248c6-127f-41c1-9265-ebcb025ded61 req-47b09498-a4f4-443c-8ea9-b233cfb0adce tempest-TestStampPattern-6799463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:46:58 devstack sudo[109464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f
Jun 18 11:46:58 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:46:58 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root
Jun 18 11:46:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [req-b0e248c6-127f-41c1-9265-ebcb025ded61 req-47b09498-a4f4-443c-8ea9-b233cfb0adce tempest-TestStampPattern-6799463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f" returned: 0 in 0.740s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:46:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [req-b0e248c6-127f-41c1-9265-ebcb025ded61 req-47b09498-a4f4-443c-8ea9-b233cfb0adce tempest-TestStampPattern-6799463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.757s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:46:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-b0e248c6-127f-41c1-9265-ebcb025ded61 req-47b09498-a4f4-443c-8ea9-b233cfb0adce tempest-TestStampPattern-6799463 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e', 'name': 'volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '679d460d-d5ab-4d0f-a925-d0587c515d27', 'enforce_multipath': True} {{(pid=91663) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 18 11:46:59 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-b0e248c6-127f-41c1-9265-ebcb025ded61 req-47b09498-a4f4-443c-8ea9-b233cfb0adce tempest-TestStampPattern-6799463 None] attachment_update completed successfully.
Jun 18 11:47:05 devstack cinder-volume[91663]: INFO cinder.volume.manager [req-ad9339d7-2c35-4b7e-85d7-700252f7d817 req-572b2a27-f43b-4269-b3d5-72ecbcb655fc tempest-TestStampPattern-6799463 None] Terminate volume connection completed successfully.
Jun 18 11:47:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [req-ad9339d7-2c35-4b7e-85d7-700252f7d817 req-572b2a27-f43b-4269-b3d5-72ecbcb655fc tempest-TestStampPattern-6799463 None] Deleting attachment 679d460d-d5ab-4d0f-a925-d0587c515d27. {{(pid=91663) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 18 11:47:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] Acquiring lock "cinder-79825f67-cea0-4093-b65c-bc8bf8cdaa7f-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:47:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] Lock "cinder-79825f67-cea0-4093-b65c-bc8bf8cdaa7f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:47:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] Acquiring lock "cinder-quobyte-79825f67-cea0-4093-b65c-bc8bf8cdaa7f" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:47:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] Lock "cinder-quobyte-79825f67-cea0-4093-b65c-bc8bf8cdaa7f" acquired by "delete_volume" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:47:14 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea8e960-e71b-4064-9d16-a29bc2a12cb1]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:47:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:14 devstack sudo[109952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f
Jun 18 11:47:14 devstack sudo[109952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:15 devstack sudo[109952]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f" returned: 0 in 0.746s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:15 devstack sudo[109958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f
Jun 18 11:47:15 devstack sudo[109958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:15 devstack sudo[109958]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79825f67-cea0-4093-b65c-bc8bf8cdaa7f" returned: 0 in 0.629s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] Lock "cinder-quobyte-79825f67-cea0-4093-b65c-bc8bf8cdaa7f" released by "delete_volume" :: held 1.410s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:47:15 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] Created reservations ['f5f4c64c-8141-4e89-9d3e-da67748adefa', '72bad40b-a739-4e17-8f9c-9b69c4f4100d', '8928bbb7-df52-403a-b1b9-e62d41d69a65', '15cc3c47-0719-479b-92f8-02975a4ca095'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:47:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:47:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:47:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:47:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:47:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:47:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:15 devstack sudo[109961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:47:15 devstack sudo[109961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:16 devstack sudo[109961]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.625s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:16 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:47:16 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] Deleted volume successfully.
Jun 18 11:47:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-20ba1f47-d1c6-4171-a651-c407dc729ce6 tempest-TestStampPattern-6799463 None] Lock "cinder-79825f67-cea0-4093-b65c-bc8bf8cdaa7f-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:47:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] Acquiring lock "cinder-b5e55189-04da-4af9-9f15-ab15b6af5457-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:47:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] Lock "cinder-b5e55189-04da-4af9-9f15-ab15b6af5457-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:47:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] Acquiring lock "cinder-quobyte-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:47:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] Lock "cinder-quobyte-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:47:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] Acquiring lock "cinder-quobyte-b5e55189-04da-4af9-9f15-ab15b6af5457" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:47:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] Lock "cinder-quobyte-b5e55189-04da-4af9-9f15-ab15b6af5457" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:47:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] Deleting offline snapshot b5e55189-04da-4af9-9f15-ab15b6af5457 of volume 7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:47:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] snapshot_file for this snap is: volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:47:16 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[168699ad-3ea8-4473-b76a-f2df90842d48]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:47:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:16 devstack sudo[109964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457
Jun 18 11:47:16 devstack sudo[109964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:17 devstack sudo[109964]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457" returned: 0 in 0.744s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:47:17 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[286bf8ad-7d82-4843-bdd2-7a2ce27d0523]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:47:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:17 devstack sudo[109970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4
Jun 18 11:47:17 devstack sudo[109970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:18 devstack sudo[109970]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4" returned: 0 in 0.725s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:18 devstack sudo[109975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457
Jun 18 11:47:18 devstack sudo[109975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:19 devstack sudo[109975]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457" returned: 0 in 0.734s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:19 devstack sudo[109980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457
Jun 18 11:47:19 devstack sudo[109980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:19 devstack sudo[109980]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4.b5e55189-04da-4af9-9f15-ab15b6af5457" returned: 0 in 0.637s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] Lock "cinder-quobyte-b5e55189-04da-4af9-9f15-ab15b6af5457" released by "_delete_snapshot" :: held 2.930s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:47:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] Lock "cinder-quobyte-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4" released by "delete_snapshot" :: held 2.950s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:47:19 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] Created reservations ['a9c98d97-69b0-4918-9a68-c6d5fcd563d2', '8dbc921f-3c2f-45e6-9263-57cae3758d94', '8ea2f077-4d16-483e-810d-fd1acba2dd5a', '4b13fe04-8b44-47ee-94ff-1c921e83f51a'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:47:19 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] Delete snapshot completed successfully.
Jun 18 11:47:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e84e602-21d3-489d-939c-b99cf963da6f tempest-TestStampPattern-6799463 None] Lock "cinder-b5e55189-04da-4af9-9f15-ab15b6af5457-delete_snapshot" released by "delete_snapshot" :: held 3.078s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:47:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:47:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:47:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:47:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:47:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:47:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:47:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:25 devstack sudo[110027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:47:25 devstack sudo[110027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:26 devstack sudo[110027]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.680s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:47:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:47:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:47:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:47:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] Acquiring lock "cinder-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:47:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] Lock "cinder-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:47:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] Acquiring lock "cinder-quobyte-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:47:27 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] Lock "cinder-quobyte-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4" acquired by "delete_volume" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:47:27 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56b3ca3-8d77-4332-b09c-cf6b06b03385]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:47:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:27 devstack sudo[110066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4
Jun 18 11:47:27 devstack sudo[110066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:27 devstack sudo[110066]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4" returned: 0 in 0.744s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:27 devstack sudo[110071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4
Jun 18 11:47:27 devstack sudo[110071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:28 devstack sudo[110071]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4" returned: 0 in 0.624s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:28 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] Lock "cinder-quobyte-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4" released by "delete_volume" :: held 1.425s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:47:28 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] Created reservations ['aadee3d2-953f-4104-a13e-c39fa9043463', 'c0f5f080-787b-4761-bd68-87c3515cf205', '80e9a3e8-3eeb-4aef-b2d7-95c11bea3459', '9b431d39-c353-47e7-a423-b5333d4412af'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:47:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:47:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:47:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:47:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:47:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:47:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:28 devstack sudo[110074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:47:28 devstack sudo[110074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:29 devstack sudo[110074]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.658s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:29 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:47:29 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] Deleted volume successfully.
Jun 18 11:47:29 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7e047cf1-da2e-4865-95f4-536ecaef76e2 tempest-TestStampPattern-6799463 None] Lock "cinder-7190e1d4-d0a4-4f56-bfa2-e2c9c96c58c4-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:47:38 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=22,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=1 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:47:39 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=22,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:47:41 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:47:41 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Flow 'volume_create_manager' (8221c5b4-8208-4c52-b34e-f11243048c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:47:41 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08bc3625-4f11-47a0-9716-1f7d29ccc40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:47:41 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08bc3625-4f11-47a0-9716-1f7d29ccc40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbb4ad0-b7f2-4217-a080-7e1f8f31019b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6caba53a07bc4a2eb7d01661c99a7a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:47:42Z,use_quota=True,user_id='cee0c07c749e43d88b624d779603cf86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:47:41 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf480fd-d3d1-4885-b400-07f69121c3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:47:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf480fd-d3d1-4885-b400-07f69121c3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:47:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9605a2d1-d6d2-4453-8d4e-c283a375a4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:47:42 devstack cinder-volume[91663]: DEBUG cinder.image.glance [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Creating Keystone auth plugin from conf {{(pid=91663) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 18 11:47:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9605a2d1-d6d2-4453-8d4e-c283a375a4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1dbb4ad0-b7f2-4217-a080-7e1f8f31019b', 'volume_name': 'volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b', 'volume_size': 1, 'image_id': '91a2e3cf-9a86-4cd1-ba85-e687924542ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/91a2e3cf-9a86-4cd1-ba85-e687924542ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f50d37cfa57dca216939f84a997db54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6caba53a07bc4a2eb7d01661c99a7a4d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8c46f4dc2400215ecbaaf7405ec537f4aea97ff3f5c00ddf21eac809e723b699c16abdd840bbf67e5d97bcc98f80e5195763823fe6ad842d27bc55b771001dd3', 'id': '91a2e3cf-9a86-4cd1-ba85-e687924542ad', 'created_at': datetime.datetime(2026, 6, 18, 9, 47, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 47, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/91a2e3cf-9a86-4cd1-ba85-e687924542ad/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ffb180560>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:47:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627280bc-13ae-44bd-a143-332ab00b5a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:47:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627280bc-13ae-44bd-a143-332ab00b5a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:47:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8660dd4f-dfe3-4892-86e5-609a65da10e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:47:42 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Volume 1dbb4ad0-b7f2-4217-a080-7e1f8f31019b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b', 'volume_size': 1, 'image_id': '91a2e3cf-9a86-4cd1-ba85-e687924542ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/91a2e3cf-9a86-4cd1-ba85-e687924542ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f50d37cfa57dca216939f84a997db54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6caba53a07bc4a2eb7d01661c99a7a4d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8c46f4dc2400215ecbaaf7405ec537f4aea97ff3f5c00ddf21eac809e723b699c16abdd840bbf67e5d97bcc98f80e5195763823fe6ad842d27bc55b771001dd3', 'id': '91a2e3cf-9a86-4cd1-ba85-e687924542ad', 'created_at': datetime.datetime(2026, 6, 18, 9, 47, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 47, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/91a2e3cf-9a86-4cd1-ba85-e687924542ad/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ffb180560>}
Jun 18 11:47:42 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Trying to clone 1dbb4ad0-b7f2-4217-a080-7e1f8f31019b from image 91a2e3cf-9a86-4cd1-ba85-e687924542ad at location (None, [{'url': 'file:///opt/stack/data/glance/images/91a2e3cf-9a86-4cd1-ba85-e687924542ad', 'metadata': {}}]). {{(pid=91663) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 18 11:47:42 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 18 11:47:42 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Image download 0.00 MB at 0.00 MB/s
Jun 18 11:47:42 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7beebb-361b-44c9-98ce-49c87b07f501]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:47:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:42 devstack sudo[110084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD
Jun 18 11:47:42 devstack sudo[110084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:43 devstack sudo[110084]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD" returned: 0 in 0.712s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:43 devstack sudo[110088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD
Jun 18 11:47:43 devstack sudo[110088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:43 devstack sudo[110088]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD" returned: 1 in 0.698s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:47:43 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Temporary image 91a2e3cf-9a86-4cd1-ba85-e687924542ad is fetched for user cee0c07c749e43d88b624d779603cf86. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 18 11:47:43 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[900af788-4247-4633-8375-cc6bba08f678]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:47:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:43 devstack sudo[110093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD
Jun 18 11:47:43 devstack sudo[110093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:44 devstack sudo[110093]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD" returned: 0 in 0.700s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:44 devstack sudo[110097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD
Jun 18 11:47:44 devstack sudo[110097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:45 devstack sudo[110097]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD" returned: 1 in 0.702s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:47:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:47:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:47:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbb4ad0-b7f2-4217-a080-7e1f8f31019b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6caba53a07bc4a2eb7d01661c99a7a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:47:42Z,use_quota=True,user_id='cee0c07c749e43d88b624d779603cf86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:47:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Creating volume 1dbb4ad0-b7f2-4217-a080-7e1f8f31019b {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:47:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:47:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:47:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:47:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:47:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:47:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:47:45 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:47:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:45 devstack sudo[110102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b 1073741824
Jun 18 11:47:45 devstack sudo[110102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:46 devstack sudo[110102]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b 1073741824" returned: 0 in 0.778s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:46 devstack sudo[110108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b
Jun 18 11:47:46 devstack sudo[110108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:46 devstack sudo[110108]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b" returned: 0 in 0.636s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:47:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:47:46 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Attempting download of 91a2e3cf-9a86-4cd1-ba85-e687924542ad ((None, [{'url': 'file:///opt/stack/data/glance/images/91a2e3cf-9a86-4cd1-ba85-e687924542ad', 'metadata': {}}])) to volume 1dbb4ad0-b7f2-4217-a080-7e1f8f31019b. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 18 11:47:46 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1f956f-d75f-49e5-b7c3-14f6c95c08ec]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:47:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_91a2e3cf-9a86-4cd1-ba85-e687924542ad_yyz8bzbp {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:46 devstack sudo[110111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_91a2e3cf-9a86-4cd1-ba85-e687924542ad_yyz8bzbp
Jun 18 11:47:46 devstack sudo[110111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:47 devstack sudo[110111]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_91a2e3cf-9a86-4cd1-ba85-e687924542ad_yyz8bzbp" returned: 0 in 0.721s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91a2e3cf-9a86-4cd1-ba85-e687924542ad_yyz8bzbp {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:47 devstack sudo[110115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91a2e3cf-9a86-4cd1-ba85-e687924542ad_yyz8bzbp
Jun 18 11:47:47 devstack sudo[110115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:48 devstack sudo[110115]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91a2e3cf-9a86-4cd1-ba85-e687924542ad_yyz8bzbp" returned: 1 in 0.717s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91a2e3cf-9a86-4cd1-ba85-e687924542ad_yyz8bzbp' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:47:48 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d98d948-52ab-4251-8a87-20510b47efa5]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:47:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:48 devstack sudo[110119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD
Jun 18 11:47:48 devstack sudo[110119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:49 devstack sudo[110119]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD" returned: 0 in 0.759s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:49 devstack sudo[110123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD
Jun 18 11:47:49 devstack sudo[110123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:49 devstack sudo[110123]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD" returned: 1 in 0.707s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:47:49 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] 91a2e3cf-9a86-4cd1-ba85-e687924542ad was raw, converting to raw {{(pid=91663) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 18 11:47:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:49 devstack sudo[110128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b
Jun 18 11:47:49 devstack sudo[110128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:50 devstack sudo[110128]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b" returned: 0 in 0.745s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:50 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_91a2e3cf-9a86-4cd1-ba85-e687924542ad_c98ozcr9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:47:50 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Converted 0.00 MB image at 0.00 MB/s
Jun 18 11:47:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:50 devstack sudo[110134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b 1G
Jun 18 11:47:50 devstack sudo[110134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:51 devstack sudo[110134]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b 1G" returned: 0 in 0.651s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:51 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f46122c-c8a7-45a1-8842-06420f2daa0b]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:47:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:51 devstack sudo[110139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b
Jun 18 11:47:51 devstack sudo[110139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:51 devstack sudo[110139]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b" returned: 0 in 0.714s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:51 devstack sudo[110143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b
Jun 18 11:47:51 devstack sudo[110143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:52 devstack sudo[110143]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b" returned: 1 in 0.741s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:47:52 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Downloaded image 91a2e3cf-9a86-4cd1-ba85-e687924542ad ((None, [{'url': 'file:///opt/stack/data/glance/images/91a2e3cf-9a86-4cd1-ba85-e687924542ad', 'metadata': {}}])) to volume 1dbb4ad0-b7f2-4217-a080-7e1f8f31019b successfully. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 18 11:47:52 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Temporary image 91a2e3cf-9a86-4cd1-ba85-e687924542ad for user cee0c07c749e43d88b624d779603cf86 is deleted. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 18 11:47:52 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Marking volume 1dbb4ad0-b7f2-4217-a080-7e1f8f31019b as bootable. {{(pid=91663) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 18 11:47:52 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Copying metadata from image 91a2e3cf-9a86-4cd1-ba85-e687924542ad to 1dbb4ad0-b7f2-4217-a080-7e1f8f31019b. {{(pid=91663) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 18 11:47:52 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Creating volume glance metadata for volume 1dbb4ad0-b7f2-4217-a080-7e1f8f31019b backed by image 91a2e3cf-9a86-4cd1-ba85-e687924542ad with: {'image_id': '91a2e3cf-9a86-4cd1-ba85-e687924542ad', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8f50d37cfa57dca216939f84a997db54', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=91663) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 18 11:47:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8660dd4f-dfe3-4892-86e5-609a65da10e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b', 'volume_size': 1, 'image_id': '91a2e3cf-9a86-4cd1-ba85-e687924542ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/91a2e3cf-9a86-4cd1-ba85-e687924542ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f50d37cfa57dca216939f84a997db54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6caba53a07bc4a2eb7d01661c99a7a4d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8c46f4dc2400215ecbaaf7405ec537f4aea97ff3f5c00ddf21eac809e723b699c16abdd840bbf67e5d97bcc98f80e5195763823fe6ad842d27bc55b771001dd3', 'id': '91a2e3cf-9a86-4cd1-ba85-e687924542ad', 'created_at': datetime.datetime(2026, 6, 18, 9, 47, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 47, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/91a2e3cf-9a86-4cd1-ba85-e687924542ad/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ffb180560>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:47:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f13c68-981a-4797-81c7-f86cfb0ed465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:47:52 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Volume volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b (1dbb4ad0-b7f2-4217-a080-7e1f8f31019b): created successfully
Jun 18 11:47:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f13c68-981a-4797-81c7-f86cfb0ed465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:47:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Flow 'volume_create_manager' (8221c5b4-8208-4c52-b34e-f11243048c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:47:52 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-c0786a6a-f62e-41d9-9450-249a8d30028a tempest-VolumeImageDependencyTests-1754236684 None] Created volume successfully.
Jun 18 11:47:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Acquiring lock "cinder-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:47:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Lock "cinder-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:47:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Acquiring lock "cinder-quobyte-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:47:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Lock "cinder-quobyte-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b" acquired by "delete_volume" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:47:53 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[5495768b-bd97-4370-8854-3d059c6ccc39]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:47:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:53 devstack sudo[110148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b
Jun 18 11:47:53 devstack sudo[110148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:54 devstack sudo[110148]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b" returned: 0 in 0.729s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:54 devstack sudo[110152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b
Jun 18 11:47:54 devstack sudo[110152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:55 devstack sudo[110152]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b" returned: 1 in 0.728s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:47:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:55 devstack sudo[110159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b
Jun 18 11:47:55 devstack sudo[110159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:55 devstack sudo[110159]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b" returned: 0 in 0.633s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Lock "cinder-quobyte-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b" released by "delete_volume" :: held 2.143s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:47:55 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Created reservations ['4e8f423d-4ac9-4ab5-8121-1a2938e98fa2', '8600f3f6-aa87-4131-be7d-69c7ebce6823', '2cae9513-a8e3-4703-837e-a9ebe25d614a', '473d3b95-9ab4-4de7-9ee5-9a323c2deb62'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:47:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:47:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:47:55 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:47:55 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:47:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:47:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:47:55 devstack sudo[110162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:47:55 devstack sudo[110162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:47:56 devstack sudo[110162]: pam_unix(sudo:session): session closed for user root
Jun 18 11:47:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.646s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:47:56 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:47:56 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Deleted volume successfully.
Jun 18 11:47:56 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d1dd17c5-bb99-4fb7-99d0-5664024d74b2 tempest-VolumeImageDependencyTests-1754236684 None] Lock "cinder-1dbb4ad0-b7f2-4217-a080-7e1f8f31019b-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:05 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=14,cinder:INSERT=8,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:48:06 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=12,cinder:UPDATE=13,cinder:INSERT=6,cinder:DELETE=1 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Flow 'volume_create_manager' (81a896a1-7e26-478b-8a4a-12a3873356b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9eb945-a872-44e0-9810-337fd1be6923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9eb945-a872-44e0-9810-337fd1be6923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-381841626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334057db-895d-406a-b450-5efc5cf87940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd4ee3c28af4e66826ef0ccde0bb723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:09Z,use_quota=True,user_id='2ce997821a4140ca921e05875010acbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0924b4-cdd1-432e-a811-55e091964b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0924b4-cdd1-432e-a811-55e091964b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217ef676-b4b7-48b3-93a8-4561a580b69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217ef676-b4b7-48b3-93a8-4561a580b69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '334057db-895d-406a-b450-5efc5cf87940', 'volume_name': 'volume-334057db-895d-406a-b450-5efc5cf87940', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be7fc24-b6c3-4fe2-829c-07fe19e4da2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be7fc24-b6c3-4fe2-829c-07fe19e4da2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d257476b-14fc-4feb-93c8-d586a16963d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:09 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Volume 334057db-895d-406a-b450-5efc5cf87940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-334057db-895d-406a-b450-5efc5cf87940', 'volume_size': 1}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-381841626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334057db-895d-406a-b450-5efc5cf87940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd4ee3c28af4e66826ef0ccde0bb723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:09Z,use_quota=True,user_id='2ce997821a4140ca921e05875010acbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Creating volume 334057db-895d-406a-b450-5efc5cf87940 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:48:09 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:09 devstack sudo[110215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940 1073741824
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:09 devstack sudo[110215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Flow 'volume_create_manager' (7ec598d5-ff2c-4912-98d2-5abc4432e211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1583ac08-a35a-4f44-a23d-0d154115850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1583ac08-a35a-4f44-a23d-0d154115850b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2078401872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2c4aa5-fa1a-4460-8d09-09a7877471bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6addca7b89cb42b1a336ce55c67e90c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:09Z,use_quota=True,user_id='b5c6d25abf254044805dd2a58670bb22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3fedf6-c502-4c70-b7bf-8e49661e230a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3fedf6-c502-4c70-b7bf-8e49661e230a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a6da60-c352-4dcc-8918-67da97a51a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a6da60-c352-4dcc-8918-67da97a51a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e2c4aa5-fa1a-4460-8d09-09a7877471bc', 'volume_name': 'volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cee75e-9654-4770-9b5d-4f5ca830799a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cee75e-9654-4770-9b5d-4f5ca830799a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62de9b5c-d9cc-4505-87e1-e456580c21b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:09 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume 1e2c4aa5-fa1a-4460-8d09-09a7877471bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc', 'volume_size': 1}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Flow 'volume_create_manager' (dac668f3-cafa-4c57-8d64-ec2788482c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e27a24-d620-4afb-a861-2bedacfc4c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e27a24-d620-4afb-a861-2bedacfc4c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-96344112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6206eb6-bb2b-4a54-8b07-87de9dd5d98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660486cb5fdc465b9e15ba46f67055f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:09Z,use_quota=True,user_id='ac4c0b3260d14388a1663b1799a4f37d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eaa4c4d-9891-4d57-8e08-8179e443d650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eaa4c4d-9891-4d57-8e08-8179e443d650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29c9beb-e277-4dcc-bb97-acb69a8c2532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29c9beb-e277-4dcc-bb97-acb69a8c2532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6206eb6-bb2b-4a54-8b07-87de9dd5d98f', 'volume_name': 'volume-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd41b81-c739-4633-819d-59bbc2551f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd41b81-c739-4633-819d-59bbc2551f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7cf3d99-5b7b-4f61-afd7-5013765f3b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:09 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Volume f6206eb6-bb2b-4a54-8b07-87de9dd5d98f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f', 'volume_size': 1}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:09 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Flow 'volume_create_manager' (ce9543fb-d069-4460-8970-440f12a24c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c26530-2edf-4104-9210-c90624d6d725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c26530-2edf-4104-9210-c90624d6d725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-366022494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81f0506-3014-45e8-aad7-313142482740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660486cb5fdc465b9e15ba46f67055f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:10Z,use_quota=True,user_id='ac4c0b3260d14388a1663b1799a4f37d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042808b3-b723-449f-bafe-182091caf1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042808b3-b723-449f-bafe-182091caf1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72634a7-5195-44b1-9e42-e59e67b1cb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72634a7-5195-44b1-9e42-e59e67b1cb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f81f0506-3014-45e8-aad7-313142482740', 'volume_name': 'volume-f81f0506-3014-45e8-aad7-313142482740', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c1f0c0-2d13-4c32-a4a4-b09a97bc4673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c1f0c0-2d13-4c32-a4a4-b09a97bc4673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d29ac6-10fb-4c88-b96c-a11d18205601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:10 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Volume f81f0506-3014-45e8-aad7-313142482740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f81f0506-3014-45e8-aad7-313142482740', 'volume_size': 1}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:10 devstack sudo[110215]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940 1073741824" returned: 0 in 1.062s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:10 devstack sudo[110222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940
Jun 18 11:48:10 devstack sudo[110222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Flow 'volume_create_manager' (f9da6e54-889c-4f8d-9242-d339fee51abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70456cdd-156b-408d-9b0b-d0bcc00ea1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70456cdd-156b-408d-9b0b-d0bcc00ea1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1239440646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce85030-1c59-44d9-908b-39fe8c08ca97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660486cb5fdc465b9e15ba46f67055f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:10Z,use_quota=True,user_id='ac4c0b3260d14388a1663b1799a4f37d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871eb0a6-3c2f-439f-aec5-6bc1373e151c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871eb0a6-3c2f-439f-aec5-6bc1373e151c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b98da6-8a60-4b79-8c26-029c6259c01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b98da6-8a60-4b79-8c26-029c6259c01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ce85030-1c59-44d9-908b-39fe8c08ca97', 'volume_name': 'volume-4ce85030-1c59-44d9-908b-39fe8c08ca97', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1204b0c-bc89-41b4-83be-8155420f132f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1204b0c-bc89-41b4-83be-8155420f132f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7070eb-6ae4-484e-a275-5f1f6df8674a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:10 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Volume 4ce85030-1c59-44d9-908b-39fe8c08ca97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ce85030-1c59-44d9-908b-39fe8c08ca97', 'volume_size': 1}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Flow 'volume_create_manager' (67ae79f0-9ec4-4d50-9c53-b478170dba32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868fd491-c2e1-4888-8996-af1fe882618d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868fd491-c2e1-4888-8996-af1fe882618d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-633593250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585fca99-d1da-4c6f-b46f-6e52f9098537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660486cb5fdc465b9e15ba46f67055f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:11Z,use_quota=True,user_id='ac4c0b3260d14388a1663b1799a4f37d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dddb3716-ba71-44c6-99e8-7e75ec8df390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dddb3716-ba71-44c6-99e8-7e75ec8df390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d0bd29-cfa3-44d7-9291-bd6b2d24a086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d0bd29-cfa3-44d7-9291-bd6b2d24a086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '585fca99-d1da-4c6f-b46f-6e52f9098537', 'volume_name': 'volume-585fca99-d1da-4c6f-b46f-6e52f9098537', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4190bd-4cdb-471a-b4c3-972f9d5e951b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4190bd-4cdb-471a-b4c3-972f9d5e951b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e6b29d-8b0e-4bed-979d-1addea9ad262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:10 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Volume 585fca99-d1da-4c6f-b46f-6e52f9098537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-585fca99-d1da-4c6f-b46f-6e52f9098537', 'volume_size': 1}
Jun 18 11:48:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:11 devstack sudo[110222]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940" returned: 0 in 0.786s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.743s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2078401872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2c4aa5-fa1a-4460-8d09-09a7877471bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6addca7b89cb42b1a336ce55c67e90c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:09Z,use_quota=True,user_id='b5c6d25abf254044805dd2a58670bb22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Creating volume 1e2c4aa5-fa1a-4460-8d09-09a7877471bc {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:48:11 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d257476b-14fc-4feb-93c8-d586a16963d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-334057db-895d-406a-b450-5efc5cf87940', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:11 devstack sudo[110225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc 1073741824
Jun 18 11:48:11 devstack sudo[110225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc79db6-f02e-4be6-b99e-5b454865e74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:11 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Volume volume-334057db-895d-406a-b450-5efc5cf87940 (334057db-895d-406a-b450-5efc5cf87940): created successfully
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc79db6-f02e-4be6-b99e-5b454865e74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Flow 'volume_create_manager' (81a896a1-7e26-478b-8a4a-12a3873356b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:11 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-f0196160-83b8-4216-aa4c-34592c630b80 tempest-VolumeDependencyTests-504466213 None] Created volume successfully.
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Flow 'volume_create_manager' (ea746ce2-1c6e-4787-91f2-514547163eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1504a7-e403-4180-b049-44d526996386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1504a7-e403-4180-b049-44d526996386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-270916574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d508ce-1783-4728-9992-ca43a5f4ad87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660486cb5fdc465b9e15ba46f67055f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:11Z,use_quota=True,user_id='ac4c0b3260d14388a1663b1799a4f37d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3223e5b5-e431-4ec6-8849-ef005d0c8fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3223e5b5-e431-4ec6-8849-ef005d0c8fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323e1077-ac13-4e63-a75a-a64a6ce1501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323e1077-ac13-4e63-a75a-a64a6ce1501c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d508ce-1783-4728-9992-ca43a5f4ad87', 'volume_name': 'volume-57d508ce-1783-4728-9992-ca43a5f4ad87', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81328ad4-611d-444e-8afd-4331610d7338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81328ad4-611d-444e-8afd-4331610d7338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bb4bd3-daf4-433e-aff9-9e81f6b516ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:11 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Volume 57d508ce-1783-4728-9992-ca43a5f4ad87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d508ce-1783-4728-9992-ca43a5f4ad87', 'volume_size': 1}
Jun 18 11:48:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:12 devstack sudo[110225]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc 1073741824" returned: 0 in 0.912s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:12 devstack sudo[110231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc
Jun 18 11:48:12 devstack sudo[110231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:12 devstack sudo[110231]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc" returned: 0 in 0.688s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.099s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-96344112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6206eb6-bb2b-4a54-8b07-87de9dd5d98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660486cb5fdc465b9e15ba46f67055f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:09Z,use_quota=True,user_id='ac4c0b3260d14388a1663b1799a4f37d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Creating volume f6206eb6-bb2b-4a54-8b07-87de9dd5d98f {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:48:12 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62de9b5c-d9cc-4505-87e1-e456580c21b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:12 devstack sudo[110234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f 1073741824
Jun 18 11:48:12 devstack sudo[110234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98d65e2-fc3d-4d06-8274-6252d9f7099d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:12 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc (1e2c4aa5-fa1a-4460-8d09-09a7877471bc): created successfully
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98d65e2-fc3d-4d06-8274-6252d9f7099d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Flow 'volume_create_manager' (7ec598d5-ff2c-4912-98d2-5abc4432e211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:12 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-5cd16c17-c93a-472f-aed8-44a5298e0b20 tempest-CreateVolumesFromSnapshotTest-949316328 None] Created volume successfully.
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Flow 'volume_create_manager' (6a2d6de1-ed89-4340-8a82-5dc2c35cb626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20aa3354-2a8a-4e5c-842b-51f45a7630c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20aa3354-2a8a-4e5c-842b-51f45a7630c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e440afe5-9ff8-41b2-b755-3d937730f49c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2e54eb06fc440abf5260a4b3d4eeec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:13Z,use_quota=True,user_id='685a18b1f1e448c095910c9f3bdf7e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(897c8408-762c-4532-bae3-8606aa4fc04f),volume_type_id=897c8408-762c-4532-bae3-8606aa4fc04f)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fcd3d4e-f09f-4d79-820b-6e7b1699132d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fcd3d4e-f09f-4d79-820b-6e7b1699132d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cf9d14-7214-45f4-bd96-cbdb6dc05a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:12 devstack cinder-volume[91663]: DEBUG cinder.image.glance [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Creating Keystone auth plugin from conf {{(pid=91663) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 18 11:48:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cf9d14-7214-45f4-bd96-cbdb6dc05a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e440afe5-9ff8-41b2-b755-3d937730f49c', 'volume_name': 'volume-e440afe5-9ff8-41b2-b755-3d937730f49c', 'volume_size': 1, 'image_id': '0d211f08-bc8a-490c-ae58-2aedac0b3118', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d211f08-bc8a-490c-ae58-2aedac0b3118', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '155a910bd2e18c8231d190e504ea4770', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d2e54eb06fc440abf5260a4b3d4eeec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0cce21128d7ee1a970d2210ead7a711ae3ada22322f5890da5da6698b0212923e2e8f7b8e4716ee7c48908d1784a4d88fc5f97f6c142d599fba4c4ae7195a524', 'id': '0d211f08-bc8a-490c-ae58-2aedac0b3118', 'created_at': datetime.datetime(2026, 6, 18, 9, 48, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 48, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d211f08-bc8a-490c-ae58-2aedac0b3118/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ffb1a9970>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4ed23f-28dc-4195-8f9e-007ee6eb24d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4ed23f-28dc-4195-8f9e-007ee6eb24d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:13 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6ac445-6117-40b4-a8b6-8954fc2be79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:13 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Volume e440afe5-9ff8-41b2-b755-3d937730f49c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e440afe5-9ff8-41b2-b755-3d937730f49c', 'volume_size': 1, 'image_id': '0d211f08-bc8a-490c-ae58-2aedac0b3118', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d211f08-bc8a-490c-ae58-2aedac0b3118', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '155a910bd2e18c8231d190e504ea4770', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d2e54eb06fc440abf5260a4b3d4eeec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0cce21128d7ee1a970d2210ead7a711ae3ada22322f5890da5da6698b0212923e2e8f7b8e4716ee7c48908d1784a4d88fc5f97f6c142d599fba4c4ae7195a524', 'id': '0d211f08-bc8a-490c-ae58-2aedac0b3118', 'created_at': datetime.datetime(2026, 6, 18, 9, 48, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 48, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d211f08-bc8a-490c-ae58-2aedac0b3118/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ffb1a9970>}
Jun 18 11:48:13 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Trying to clone e440afe5-9ff8-41b2-b755-3d937730f49c from image 0d211f08-bc8a-490c-ae58-2aedac0b3118 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0d211f08-bc8a-490c-ae58-2aedac0b3118', 'metadata': {}}]). {{(pid=91663) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 18 11:48:13 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 18 11:48:13 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Image download 0.00 MB at 0.00 MB/s
Jun 18 11:48:13 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49019ca-d9f1-4dbc-98c1-87bb95345327]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:13 devstack sudo[110239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD
Jun 18 11:48:13 devstack sudo[110239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:13 devstack sudo[110234]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f 1073741824" returned: 0 in 0.867s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:13 devstack sudo[110241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f
Jun 18 11:48:13 devstack sudo[110241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:14 devstack sudo[110239]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD" returned: 0 in 0.754s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:14 devstack sudo[110245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD
Jun 18 11:48:14 devstack sudo[110245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:14 devstack sudo[110241]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f" returned: 0 in 0.658s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.232s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-366022494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81f0506-3014-45e8-aad7-313142482740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660486cb5fdc465b9e15ba46f67055f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:10Z,use_quota=True,user_id='ac4c0b3260d14388a1663b1799a4f37d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Creating volume f81f0506-3014-45e8-aad7-313142482740 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:48:14 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f81f0506-3014-45e8-aad7-313142482740 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:14 devstack sudo[110248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f81f0506-3014-45e8-aad7-313142482740 1073741824
Jun 18 11:48:14 devstack sudo[110248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7cf3d99-5b7b-4f61-afd7-5013765f3b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f97f5f-7e81-4028-8e7f-92b4fc624c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:14 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Volume volume-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f (f6206eb6-bb2b-4a54-8b07-87de9dd5d98f): created successfully
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f97f5f-7e81-4028-8e7f-92b4fc624c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Flow 'volume_create_manager' (dac668f3-cafa-4c57-8d64-ec2788482c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:14 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-9fc26486-ed76-4c30-b95a-849304714e2f tempest-CreateVolumesFromImageTest-2114873262 None] Created volume successfully.
Jun 18 11:48:14 devstack sudo[110245]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD" returned: 1 in 0.750s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Temporary image 0d211f08-bc8a-490c-ae58-2aedac0b3118 is fetched for user 685a18b1f1e448c095910c9f3bdf7e0d. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d1d269-95e5-4dfc-9685-3e9dfcb6a627]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:15 devstack sudo[110256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD
Jun 18 11:48:15 devstack sudo[110256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:15 devstack sudo[110248]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f81f0506-3014-45e8-aad7-313142482740 1073741824" returned: 0 in 0.855s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f81f0506-3014-45e8-aad7-313142482740 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:15 devstack sudo[110259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f81f0506-3014-45e8-aad7-313142482740
Jun 18 11:48:15 devstack sudo[110259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:15 devstack sudo[110256]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD" returned: 0 in 0.729s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:15 devstack sudo[110263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD
Jun 18 11:48:15 devstack sudo[110263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:15 devstack sudo[110259]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f81f0506-3014-45e8-aad7-313142482740" returned: 0 in 0.628s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.263s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1239440646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce85030-1c59-44d9-908b-39fe8c08ca97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660486cb5fdc465b9e15ba46f67055f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:10Z,use_quota=True,user_id='ac4c0b3260d14388a1663b1799a4f37d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Creating volume 4ce85030-1c59-44d9-908b-39fe8c08ca97 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:48:15 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ce85030-1c59-44d9-908b-39fe8c08ca97 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:15 devstack sudo[110266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ce85030-1c59-44d9-908b-39fe8c08ca97 1073741824
Jun 18 11:48:15 devstack sudo[110266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d29ac6-10fb-4c88-b96c-a11d18205601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f81f0506-3014-45e8-aad7-313142482740', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87c8d84-492c-41e1-ad2b-9977f966eaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:15 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Volume volume-f81f0506-3014-45e8-aad7-313142482740 (f81f0506-3014-45e8-aad7-313142482740): created successfully
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87c8d84-492c-41e1-ad2b-9977f966eaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:15 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Flow 'volume_create_manager' (ce9543fb-d069-4460-8970-440f12a24c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:15 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-158a2de3-8ae3-431b-843a-deef609c2694 tempest-CreateVolumesFromImageTest-2114873262 None] Created volume successfully.
Jun 18 11:48:16 devstack sudo[110263]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD" returned: 1 in 0.708s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:48:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:16 devstack sudo[110266]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ce85030-1c59-44d9-908b-39fe8c08ca97 1073741824" returned: 0 in 0.839s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ce85030-1c59-44d9-908b-39fe8c08ca97 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:16 devstack sudo[110275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ce85030-1c59-44d9-908b-39fe8c08ca97
Jun 18 11:48:16 devstack sudo[110275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:17 devstack sudo[110275]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ce85030-1c59-44d9-908b-39fe8c08ca97" returned: 0 in 0.632s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:48:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.396s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-633593250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585fca99-d1da-4c6f-b46f-6e52f9098537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660486cb5fdc465b9e15ba46f67055f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:11Z,use_quota=True,user_id='ac4c0b3260d14388a1663b1799a4f37d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:48:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Creating volume 585fca99-d1da-4c6f-b46f-6e52f9098537 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:48:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:48:17 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:48:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-585fca99-d1da-4c6f-b46f-6e52f9098537 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7070eb-6ae4-484e-a275-5f1f6df8674a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce85030-1c59-44d9-908b-39fe8c08ca97', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:17 devstack sudo[110278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-585fca99-d1da-4c6f-b46f-6e52f9098537 1073741824
Jun 18 11:48:17 devstack sudo[110278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e054892-1f71-4c6a-8cff-33de60bc1d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:17 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Volume volume-4ce85030-1c59-44d9-908b-39fe8c08ca97 (4ce85030-1c59-44d9-908b-39fe8c08ca97): created successfully
Jun 18 11:48:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e054892-1f71-4c6a-8cff-33de60bc1d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:17 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Flow 'volume_create_manager' (f9da6e54-889c-4f8d-9242-d339fee51abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:17 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-053bbf4b-0f81-463a-9ceb-4f098bac91e4 tempest-CreateVolumesFromImageTest-2114873262 None] Created volume successfully.
Jun 18 11:48:18 devstack sudo[110278]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-585fca99-d1da-4c6f-b46f-6e52f9098537 1073741824" returned: 0 in 0.820s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-585fca99-d1da-4c6f-b46f-6e52f9098537 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:18 devstack sudo[110283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-585fca99-d1da-4c6f-b46f-6e52f9098537
Jun 18 11:48:18 devstack sudo[110283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:18 devstack sudo[110283]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-585fca99-d1da-4c6f-b46f-6e52f9098537" returned: 0 in 0.630s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.569s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-270916574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d508ce-1783-4728-9992-ca43a5f4ad87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660486cb5fdc465b9e15ba46f67055f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:11Z,use_quota=True,user_id='ac4c0b3260d14388a1663b1799a4f37d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Creating volume 57d508ce-1783-4728-9992-ca43a5f4ad87 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:48:18 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-57d508ce-1783-4728-9992-ca43a5f4ad87 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e6b29d-8b0e-4bed-979d-1addea9ad262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585fca99-d1da-4c6f-b46f-6e52f9098537', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:18 devstack sudo[110286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-57d508ce-1783-4728-9992-ca43a5f4ad87 1073741824
Jun 18 11:48:18 devstack sudo[110286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec6d361-0cf5-4161-9305-7472e090e924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:18 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Volume volume-585fca99-d1da-4c6f-b46f-6e52f9098537 (585fca99-d1da-4c6f-b46f-6e52f9098537): created successfully
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec6d361-0cf5-4161-9305-7472e090e924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:18 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Flow 'volume_create_manager' (67ae79f0-9ec4-4d50-9c53-b478170dba32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:18 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-000c95c2-cfc7-424b-b7c5-6fa77dfc3d18 tempest-CreateVolumesFromImageTest-2114873262 None] Created volume successfully.
Jun 18 11:48:19 devstack sudo[110286]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-57d508ce-1783-4728-9992-ca43a5f4ad87 1073741824" returned: 0 in 0.804s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-57d508ce-1783-4728-9992-ca43a5f4ad87 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:19 devstack sudo[110292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-57d508ce-1783-4728-9992-ca43a5f4ad87
Jun 18 11:48:19 devstack sudo[110292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:20 devstack sudo[110292]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-57d508ce-1783-4728-9992-ca43a5f4ad87" returned: 0 in 0.642s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:20 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:48:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.151s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bb4bd3-daf4-433e-aff9-9e81f6b516ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d508ce-1783-4728-9992-ca43a5f4ad87', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab67838b-0fad-4455-aef0-798c12a068d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:20 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] Creating offline snapshot 70515794-5bf1-4fee-8255-bf685363f8e5 of volume 334057db-895d-406a-b450-5efc5cf87940 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:48:20 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Volume volume-57d508ce-1783-4728-9992-ca43a5f4ad87 (57d508ce-1783-4728-9992-ca43a5f4ad87): created successfully
Jun 18 11:48:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab67838b-0fad-4455-aef0-798c12a068d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:20 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Flow 'volume_create_manager' (ea746ce2-1c6e-4787-91f2-514547163eb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:20 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f8e4ea-f0cf-4a4c-93aa-1bdedcdd0d1e]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:20 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-89253afe-b601-4e58-8fd3-5fb33e6d6626 tempest-CreateVolumesFromImageTest-2114873262 None] Created volume successfully.
Jun 18 11:48:20 devstack sudo[110296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940
Jun 18 11:48:20 devstack sudo[110296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "cinder-57d508ce-1783-4728-9992-ca43a5f4ad87-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-57d508ce-1783-4728-9992-ca43a5f4ad87-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "cinder-quobyte-57d508ce-1783-4728-9992-ca43a5f4ad87" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-quobyte-57d508ce-1783-4728-9992-ca43a5f4ad87" acquired by "delete_volume" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:21 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[52745c6c-9377-4d7e-885d-b45301cca3df]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-57d508ce-1783-4728-9992-ca43a5f4ad87 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:21 devstack sudo[110296]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940" returned: 0 in 0.812s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:21 devstack sudo[110302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5 1G
Jun 18 11:48:21 devstack sudo[110302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:21 devstack sudo[110301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-57d508ce-1783-4728-9992-ca43a5f4ad87
Jun 18 11:48:21 devstack sudo[110301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:21 devstack sudo[110301]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-57d508ce-1783-4728-9992-ca43a5f4ad87" returned: 0 in 0.750s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-57d508ce-1783-4728-9992-ca43a5f4ad87 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:21 devstack sudo[110312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-57d508ce-1783-4728-9992-ca43a5f4ad87
Jun 18 11:48:21 devstack sudo[110312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:22 devstack sudo[110302]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5 1G" returned: 0 in 0.795s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-334057db-895d-406a-b450-5efc5cf87940 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:22 devstack sudo[110314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-334057db-895d-406a-b450-5efc5cf87940 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5
Jun 18 11:48:22 devstack sudo[110314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:22 devstack sudo[110312]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-57d508ce-1783-4728-9992-ca43a5f4ad87" returned: 0 in 0.651s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:22 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-quobyte-57d508ce-1783-4728-9992-ca43a5f4ad87" released by "delete_volume" :: held 1.449s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:22 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] Created reservations ['47287ddb-6074-4b33-8da8-18806fef8171', '9f96fdca-1652-4b2e-9006-df8fb6b22bab', '9bbb9d2d-ef79-4d6f-8abb-a3533f730d64', '55b9d877-c6b3-4bd6-8ef3-9e9db4fb1825'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:48:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:22 devstack sudo[110320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:48:22 devstack sudo[110320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:22 devstack sudo[110314]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-334057db-895d-406a-b450-5efc5cf87940 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5" returned: 0 in 0.735s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:22 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5 is being set with open permissions: ugo+rw
Jun 18 11:48:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:22 devstack sudo[110322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5
Jun 18 11:48:22 devstack sudo[110322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "cinder-585fca99-d1da-4c6f-b46f-6e52f9098537-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-585fca99-d1da-4c6f-b46f-6e52f9098537-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:23 devstack sudo[110320]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.686s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:23 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:48:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "cinder-quobyte-585fca99-d1da-4c6f-b46f-6e52f9098537" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:23 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] Deleted volume successfully.
Jun 18 11:48:23 devstack sudo[110322]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-quobyte-585fca99-d1da-4c6f-b46f-6e52f9098537" acquired by "delete_volume" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5" returned: 0 in 0.681s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d46da1b3-718e-4be6-bad9-402536cabcaf tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-57d508ce-1783-4728-9992-ca43a5f4ad87-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:23 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8b8bf2-9a01-4361-8ce3-014bf740114d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-585fca99-d1da-4c6f-b46f-6e52f9098537 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:23 devstack sudo[110327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.info
Jun 18 11:48:23 devstack sudo[110327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:23 devstack sudo[110326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-585fca99-d1da-4c6f-b46f-6e52f9098537
Jun 18 11:48:23 devstack sudo[110326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:24 devstack sudo[110327]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.info" returned: 0 in 0.647s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:24 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.info is being set with open permissions: ugo+rw
Jun 18 11:48:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:24 devstack sudo[110334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.info
Jun 18 11:48:24 devstack sudo[110334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:24 devstack sudo[110326]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-585fca99-d1da-4c6f-b46f-6e52f9098537" returned: 0 in 0.739s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-585fca99-d1da-4c6f-b46f-6e52f9098537 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:24 devstack sudo[110336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-585fca99-d1da-4c6f-b46f-6e52f9098537
Jun 18 11:48:24 devstack sudo[110336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:24 devstack sudo[110334]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.info" returned: 0 in 0.671s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.467s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.451s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:24 devstack sudo[110336]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-585fca99-d1da-4c6f-b46f-6e52f9098537" returned: 0 in 0.649s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:24 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] Creating offline snapshot 34a38c99-f13d-4a96-b633-5ad3f51a3e77 of volume 1e2c4aa5-fa1a-4460-8d09-09a7877471bc {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:48:24 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-quobyte-585fca99-d1da-4c6f-b46f-6e52f9098537" released by "delete_volume" :: held 1.436s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:24 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb91f137-cc09-4b1c-bbb2-bdc05dbfe47a]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:24 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-cdb39535-2b86-45f0-bd71-b8e75c8abb46 tempest-VolumeDependencyTests-504466213 None] Create snapshot completed successfully
Jun 18 11:48:24 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] Created reservations ['6451235b-99b5-4aff-b3ff-e5d441f3d7c8', 'b2db6e81-a91f-4539-afac-e71e9723f5dd', 'a369e7fd-f349-42cc-b150-0559055a41e1', '5953ba38-c59d-4357-add0-f52e057b56dc'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:48:25 devstack sudo[110340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:25 devstack sudo[110340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:25 devstack sudo[110342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:48:25 devstack sudo[110342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:25 devstack sudo[110344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:48:25 devstack sudo[110344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "cinder-4ce85030-1c59-44d9-908b-39fe8c08ca97-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-4ce85030-1c59-44d9-908b-39fe8c08ca97-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:25 devstack sudo[110342]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:25 devstack sudo[110340]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.767s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "cinder-quobyte-4ce85030-1c59-44d9-908b-39fe8c08ca97" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:25 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] Deleted volume successfully.
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc" returned: 0 in 0.927s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-quobyte-4ce85030-1c59-44d9-908b-39fe8c08ca97" acquired by "delete_volume" :: waited 0.048s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:25 devstack sudo[110350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77 1G
Jun 18 11:48:25 devstack sudo[110350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-715a6996-4628-4a92-9cf6-006188eced76 tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-585fca99-d1da-4c6f-b46f-6e52f9098537-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[da062393-aba3-43a0-91db-417e26d65e03]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ce85030-1c59-44d9-908b-39fe8c08ca97 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:26 devstack sudo[110354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ce85030-1c59-44d9-908b-39fe8c08ca97
Jun 18 11:48:26 devstack sudo[110354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:26 devstack sudo[110344]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.796s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Flow 'volume_create_manager' (2b527dd7-8caf-40eb-a8c6-0eb7741d13a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6338e7fa-6cf9-4416-aa56-764144dc6f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6338e7fa-6cf9-4416-aa56-764144dc6f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1045755942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c903a62-e98a-4cdb-ac71-a4f85afc0d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd4ee3c28af4e66826ef0ccde0bb723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=70515794-5bf1-4fee-8255-bf685363f8e5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:27Z,use_quota=True,user_id='2ce997821a4140ca921e05875010acbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f3bcef-a8ce-4de8-9205-0b671cafffa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f3bcef-a8ce-4de8-9205-0b671cafffa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b90bbdf-b325-45c2-a3cd-48f28d0aa359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:26 devstack sudo[110354]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b90bbdf-b325-45c2-a3cd-48f28d0aa359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9c903a62-e98a-4cdb-ac71-a4f85afc0d84', 'volume_name': 'volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84', 'volume_size': 1, 'snapshot_id': '70515794-5bf1-4fee-8255-bf685363f8e5'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba2596b-b341-4a68-9438-611657e83ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba2596b-b341-4a68-9438-611657e83ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c3de8d-a836-4bb8-afcd-b950eeb8b895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:26 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Volume 9c903a62-e98a-4cdb-ac71-a4f85afc0d84: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84', 'volume_size': 1, 'snapshot_id': '70515794-5bf1-4fee-8255-bf685363f8e5'}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ce85030-1c59-44d9-908b-39fe8c08ca97" returned: 0 in 0.969s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ce85030-1c59-44d9-908b-39fe8c08ca97 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:26 devstack sudo[110397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ce85030-1c59-44d9-908b-39fe8c08ca97
Jun 18 11:48:26 devstack sudo[110397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:26 devstack sudo[110350]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77 1G" returned: 0 in 1.145s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:26 devstack sudo[110399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77
Jun 18 11:48:26 devstack sudo[110399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:27 devstack sudo[110397]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4ce85030-1c59-44d9-908b-39fe8c08ca97" returned: 0 in 0.668s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:27 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-quobyte-4ce85030-1c59-44d9-908b-39fe8c08ca97" released by "delete_volume" :: held 1.696s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:27 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] Created reservations ['d5c01bc7-7216-4025-a60b-553f9722b1dd', '5c14d500-74ab-4f3b-815e-faf5ad44dde4', 'f4a10c7f-8585-410e-90f5-f41c75b2c412', '56cc848c-cf97-45e4-92c7-fced20be3ce7'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:48:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:27 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:27 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:27 devstack sudo[110399]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77" returned: 0 in 0.737s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:27 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77 is being set with open permissions: ugo+rw
Jun 18 11:48:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:27 devstack sudo[110406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:48:27 devstack sudo[110406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:27 devstack sudo[110407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77
Jun 18 11:48:27 devstack sudo[110407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:27 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "cinder-f81f0506-3014-45e8-aad7-313142482740-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:28 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-f81f0506-3014-45e8-aad7-313142482740-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:28 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "cinder-quobyte-f81f0506-3014-45e8-aad7-313142482740" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:28 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-quobyte-f81f0506-3014-45e8-aad7-313142482740" acquired by "delete_volume" :: waited 0.018s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:28 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36c24f5-e090-4ef2-aaef-c8bf5e3be64a]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f81f0506-3014-45e8-aad7-313142482740 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:28 devstack sudo[110410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f81f0506-3014-45e8-aad7-313142482740
Jun 18 11:48:28 devstack sudo[110410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:28 devstack sudo[110407]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:28 devstack sudo[110406]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.701s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:28 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:48:28 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] Deleted volume successfully.
Jun 18 11:48:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77" returned: 0 in 0.696s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:28 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-2e9e8d65-adc1-44ca-85b5-6b689a93f8ab tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-4ce85030-1c59-44d9-908b-39fe8c08ca97-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:28 devstack sudo[110414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.info
Jun 18 11:48:28 devstack sudo[110414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:28 devstack sudo[110410]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f81f0506-3014-45e8-aad7-313142482740" returned: 0 in 0.813s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f81f0506-3014-45e8-aad7-313142482740 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:28 devstack sudo[110419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f81f0506-3014-45e8-aad7-313142482740
Jun 18 11:48:28 devstack sudo[110419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:29 devstack sudo[110414]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.info" returned: 0 in 0.663s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:29 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.info is being set with open permissions: ugo+rw
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:29 devstack sudo[110422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.info
Jun 18 11:48:29 devstack sudo[110422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:29 devstack sudo[110419]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f81f0506-3014-45e8-aad7-313142482740" returned: 0 in 0.644s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-quobyte-f81f0506-3014-45e8-aad7-313142482740" released by "delete_volume" :: held 1.505s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] Created reservations ['820395df-a7e9-4138-8c6c-9f2492cbda39', '03768e55-9ed0-4346-a13e-5c58244d2059', '963a3620-99d8-4c44-a487-841c8d8fa3d1', '969d5bcb-6d21-4885-8597-7565b833660b'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:29 devstack sudo[110426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:48:29 devstack sudo[110422]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:29 devstack sudo[110426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.info" returned: 0 in 0.655s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.933s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.409s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e440afe5-9ff8-41b2-b755-3d937730f49c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2e54eb06fc440abf5260a4b3d4eeec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:13Z,use_quota=True,user_id='685a18b1f1e448c095910c9f3bdf7e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(897c8408-762c-4532-bae3-8606aa4fc04f),volume_type_id=897c8408-762c-4532-bae3-8606aa4fc04f)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Creating volume e440afe5-9ff8-41b2-b755-3d937730f49c {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:48:29 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:48:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:29 devstack sudo[110428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c 1073741824
Jun 18 11:48:29 devstack sudo[110428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:29 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-473101c2-c4b9-4e29-9b54-e0c239d2f12a tempest-CreateVolumesFromSnapshotTest-949316328 None] Create snapshot completed successfully
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "cinder-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "cinder-quobyte-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-quobyte-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f" acquired by "delete_volume" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87ebbda-ec47-4a45-9ed9-643e957a2cb1]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:30 devstack sudo[110426]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.835s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:48:30 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] Deleted volume successfully.
Jun 18 11:48:30 devstack sudo[110435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f
Jun 18 11:48:30 devstack sudo[110435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-b9d99ab0-290a-4047-8bad-c08c557dd71c tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-f81f0506-3014-45e8-aad7-313142482740-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Flow 'volume_create_manager' (40f1c9f2-7ba3-4574-803e-ed1b2078288b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9abb74-9a88-4b1d-8872-96d7b9c32fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9abb74-9a88-4b1d-8872-96d7b9c32fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-421146470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a85654a-93ef-4c40-99ae-86b7c5c1259c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6addca7b89cb42b1a336ce55c67e90c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:31Z,use_quota=True,user_id='b5c6d25abf254044805dd2a58670bb22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68782820-e088-49ca-85ff-71f95353a674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68782820-e088-49ca-85ff-71f95353a674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6993b172-ac59-4e33-8247-5e084ab89a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6993b172-ac59-4e33-8247-5e084ab89a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a85654a-93ef-4c40-99ae-86b7c5c1259c', 'volume_name': 'volume-0a85654a-93ef-4c40-99ae-86b7c5c1259c', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd04ba7-cc6c-41d6-afe6-3e9a10418ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd04ba7-cc6c-41d6-afe6-3e9a10418ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d14f87-6509-44bd-93ed-20b807834609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:30 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume 0a85654a-93ef-4c40-99ae-86b7c5c1259c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a85654a-93ef-4c40-99ae-86b7c5c1259c', 'volume_size': 1}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:30 devstack sudo[110428]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c 1073741824" returned: 0 in 1.048s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:30 devstack sudo[110437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c
Jun 18 11:48:30 devstack sudo[110437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Flow 'volume_create_manager' (a8a2f0fc-ae50-43e5-b16c-cc6bd8c9f9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4024d7cf-3bb8-45c7-8081-44c2f05ca7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4024d7cf-3bb8-45c7-8081-44c2f05ca7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1570771544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a594c749-8306-42db-9d8c-082d4f6c6c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6addca7b89cb42b1a336ce55c67e90c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:31Z,use_quota=True,user_id='b5c6d25abf254044805dd2a58670bb22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c90fae4-4575-42e8-b318-e59a94868a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c90fae4-4575-42e8-b318-e59a94868a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58209135-a9ca-4c39-8ab2-0493f3bab2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58209135-a9ca-4c39-8ab2-0493f3bab2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a594c749-8306-42db-9d8c-082d4f6c6c49', 'volume_name': 'volume-a594c749-8306-42db-9d8c-082d4f6c6c49', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4abfd3a-f6ba-41f7-81ff-c72c1835a303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4abfd3a-f6ba-41f7-81ff-c72c1835a303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c568a1e1-e6f2-4c82-8997-7a2dc101051e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:31 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume a594c749-8306-42db-9d8c-082d4f6c6c49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a594c749-8306-42db-9d8c-082d4f6c6c49', 'volume_size': 1}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Flow 'volume_create_manager' (ea6fe8bb-c265-44c9-b0b1-0872aad8a155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8b672a-d9d5-4afd-976e-fa29953d38ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8b672a-d9d5-4afd-976e-fa29953d38ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1887511706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79535130-03e7-49ba-9cea-25828bef196a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6addca7b89cb42b1a336ce55c67e90c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:31Z,use_quota=True,user_id='b5c6d25abf254044805dd2a58670bb22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c79fa2-ba34-44a9-a3aa-da480a9bf8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c79fa2-ba34-44a9-a3aa-da480a9bf8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588464c3-bd0a-4a35-a38b-3fc5e599fe55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:31 devstack sudo[110435]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588464c3-bd0a-4a35-a38b-3fc5e599fe55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79535130-03e7-49ba-9cea-25828bef196a', 'volume_name': 'volume-79535130-03e7-49ba-9cea-25828bef196a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23844d8a-1d74-4739-81c4-d555a78ed40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23844d8a-1d74-4739-81c4-d555a78ed40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2636c551-fdee-4ff8-a5eb-655f8526d678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:31 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume 79535130-03e7-49ba-9cea-25828bef196a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79535130-03e7-49ba-9cea-25828bef196a', 'volume_size': 1}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f" returned: 0 in 1.043s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:31 devstack sudo[110443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f
Jun 18 11:48:31 devstack sudo[110443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:31 devstack sudo[110437]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c" returned: 0 in 0.793s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.840s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Acquiring lock "cinder-quobyte-70515794-5bf1-4fee-8255-bf685363f8e5-9c903a62-e98a-4cdb-ac71-a4f85afc0d84" by "_create_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Lock "cinder-quobyte-70515794-5bf1-4fee-8255-bf685363f8e5-9c903a62-e98a-4cdb-ac71-a4f85afc0d84" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Creating volume 9c903a62-e98a-4cdb-ac71-a4f85afc0d84 from snapshot 70515794-5bf1-4fee-8255-bf685363f8e5 {{(pid=91663) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Acquiring lock "cinder-quobyte-9c903a62-e98a-4cdb-ac71-a4f85afc0d84" by "_copy_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Attempting download of 0d211f08-bc8a-490c-ae58-2aedac0b3118 ((None, [{'url': 'file:///opt/stack/data/glance/images/0d211f08-bc8a-490c-ae58-2aedac0b3118', 'metadata': {}}])) to volume e440afe5-9ff8-41b2-b755-3d937730f49c. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Lock "cinder-quobyte-9c903a62-e98a-4cdb-ac71-a4f85afc0d84" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] snapshot: 70515794-5bf1-4fee-8255-bf685363f8e5, volume: 9c903a62-e98a-4cdb-ac71-a4f85afc0d84,  {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Flow 'volume_create_manager' (1456b007-37f6-497a-a41f-dd39c5838b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc19916-e093-4cd4-8a02-7b49fc975bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b3acd7-73e0-4825-a9d6-60d8fec22239]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc19916-e093-4cd4-8a02-7b49fc975bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-601225898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b20c2a-5c45-4b34-abfe-32a349902e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6addca7b89cb42b1a336ce55c67e90c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:32Z,use_quota=True,user_id='b5c6d25abf254044805dd2a58670bb22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c950da-7b57-47e5-b350-96cd42622aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c950da-7b57-47e5-b350-96cd42622aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf94f72-9797-4a6f-a732-782ef0f1e5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf94f72-9797-4a6f-a732-782ef0f1e5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96b20c2a-5c45-4b34-abfe-32a349902e37', 'volume_name': 'volume-96b20c2a-5c45-4b34-abfe-32a349902e37', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c601e7-055d-4179-9cfa-fd16eb43b945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c601e7-055d-4179-9cfa-fd16eb43b945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f69f24-ab20-4a64-9092-1e37ddf04a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:32 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume 96b20c2a-5c45-4b34-abfe-32a349902e37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96b20c2a-5c45-4b34-abfe-32a349902e37', 'volume_size': 1}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[8943628a-14a5-4cde-9dde-e834927ddf6c]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d211f08-bc8a-490c-ae58-2aedac0b3118_px0gueg3 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:32 devstack sudo[110446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5
Jun 18 11:48:32 devstack sudo[110446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:32 devstack sudo[110447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d211f08-bc8a-490c-ae58-2aedac0b3118_px0gueg3
Jun 18 11:48:32 devstack sudo[110447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Flow 'volume_create_manager' (dfea15cc-d05a-4514-9646-da51c68ff4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:32 devstack sudo[110443]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fcadb3a-b2aa-4807-aace-4ba23f0da17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f" returned: 0 in 0.815s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fcadb3a-b2aa-4807-aace-4ba23f0da17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1689878247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c49a729-deb9-4d13-8d6a-a60080424ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6addca7b89cb42b1a336ce55c67e90c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:32Z,use_quota=True,user_id='b5c6d25abf254044805dd2a58670bb22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb188dc-a199-4213-a1b7-27776061bf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb188dc-a199-4213-a1b7-27776061bf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7629fa-2717-4226-8276-bde403f2fded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7629fa-2717-4226-8276-bde403f2fded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c49a729-deb9-4d13-8d6a-a60080424ec9', 'volume_name': 'volume-4c49a729-deb9-4d13-8d6a-a60080424ec9', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7e8e3a-6cb5-40e6-b72d-523d47b9044e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7e8e3a-6cb5-40e6-b72d-523d47b9044e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88875c00-9465-4a5e-ade0-713c30b4ee02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:32 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume 4c49a729-deb9-4d13-8d6a-a60080424ec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c49a729-deb9-4d13-8d6a-a60080424ec9', 'volume_size': 1}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-quobyte-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f" released by "delete_volume" :: held 1.961s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] Created reservations ['9ed46e11-e4b1-420f-9eee-dcc3f7a136cf', '27fb328a-95de-4a58-99aa-9f094f8e0771', 'a735331c-0533-4348-b58c-9ee25c9fa155', '6c62d95c-5c3f-460c-a0ea-fb6c51ae806c'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:32 devstack sudo[110451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:48:32 devstack sudo[110451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:32 devstack sudo[110447]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d211f08-bc8a-490c-ae58-2aedac0b3118_px0gueg3" returned: 0 in 0.819s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d211f08-bc8a-490c-ae58-2aedac0b3118_px0gueg3 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:32 devstack sudo[110446]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5" returned: 0 in 0.987s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-334057db-895d-406a-b450-5efc5cf87940(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940 {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Creating direct copy from snapshot {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cc09af-7427-4f15-8a4e-7cb92129f43f]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:33 devstack sudo[110458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d211f08-bc8a-490c-ae58-2aedac0b3118_px0gueg3
Jun 18 11:48:33 devstack sudo[110458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:33 devstack sudo[110459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940
Jun 18 11:48:33 devstack sudo[110459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:33 devstack sudo[110451]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.866s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:33 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:48:33 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] Deleted volume successfully.
Jun 18 11:48:33 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-c6715f40-5b44-4b7d-9199-2037874b5b3a tempest-CreateVolumesFromImageTest-2114873262 None] Lock "cinder-f6206eb6-bb2b-4a54-8b07-87de9dd5d98f-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:33 devstack sudo[110458]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d211f08-bc8a-490c-ae58-2aedac0b3118_px0gueg3" returned: 1 in 0.855s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d211f08-bc8a-490c-ae58-2aedac0b3118_px0gueg3' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:48:33 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bd36e6-0794-4087-b304-578e783c4e0a]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:33 devstack sudo[110465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD
Jun 18 11:48:33 devstack sudo[110465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:33 devstack sudo[110459]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940" returned: 0 in 0.984s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:33 devstack cinder-volume[91663]: DEBUG cinder.utils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Path /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84 not found in is_blk_device check {{(pid=91663) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 18 11:48:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:33 devstack sudo[110471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84
Jun 18 11:48:34 devstack sudo[110471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:34 devstack sudo[110465]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD" returned: 0 in 0.920s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:34 devstack sudo[110478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD
Jun 18 11:48:34 devstack sudo[110478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:35 devstack sudo[110478]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD" returned: 1 in 1.017s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:48:35 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] 0d211f08-bc8a-490c-ae58-2aedac0b3118 was raw, converting to raw {{(pid=91663) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 18 11:48:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:35 devstack sudo[110491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c
Jun 18 11:48:35 devstack sudo[110491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:37 devstack sudo[110491]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c" returned: 0 in 1.670s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:37 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0d211f08-bc8a-490c-ae58-2aedac0b3118_dzgr37z5devstack@QuobyteHD, size 0.00 MB, duration 1.67 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:48:37 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Converted 0.00 MB image at 0.00 MB/s
Jun 18 11:48:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:37 devstack sudo[110496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c 1G
Jun 18 11:48:37 devstack sudo[110496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c 1G" returned: 0 in 1.675s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:39 devstack sudo[110496]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:39 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[577a64f5-967a-41a5-a958-b6cc3992f2d5]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:39 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:39 devstack sudo[110502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c
Jun 18 11:48:39 devstack sudo[110502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:40 devstack sudo[110471]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84" returned: 0 in 6.160s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:40 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[effc07c6-0c76-48b7-8924-a6e8e14ad413]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:40 devstack sudo[110505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940
Jun 18 11:48:40 devstack sudo[110505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:40 devstack sudo[110502]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c" returned: 0 in 1.266s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:40 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:40 devstack sudo[110509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c
Jun 18 11:48:40 devstack sudo[110509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:41 devstack sudo[110505]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940" returned: 0 in 0.950s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84 {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:48:41 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Converted 1024.00 MB image at 166.20 MB/s
Jun 18 11:48:41 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84 is being set with open permissions: ugo+rw
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:41 devstack sudo[110515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84
Jun 18 11:48:41 devstack sudo[110515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:41 devstack sudo[110509]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c" returned: 1 in 0.836s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Downloaded image 0d211f08-bc8a-490c-ae58-2aedac0b3118 ((None, [{'url': 'file:///opt/stack/data/glance/images/0d211f08-bc8a-490c-ae58-2aedac0b3118', 'metadata': {}}])) to volume e440afe5-9ff8-41b2-b755-3d937730f49c successfully. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Temporary image 0d211f08-bc8a-490c-ae58-2aedac0b3118 for user 685a18b1f1e448c095910c9f3bdf7e0d is deleted. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Marking volume e440afe5-9ff8-41b2-b755-3d937730f49c as bootable. {{(pid=91663) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Copying metadata from image 0d211f08-bc8a-490c-ae58-2aedac0b3118 to e440afe5-9ff8-41b2-b755-3d937730f49c. {{(pid=91663) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Creating volume glance metadata for volume e440afe5-9ff8-41b2-b755-3d937730f49c backed by image 0d211f08-bc8a-490c-ae58-2aedac0b3118 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0d211f08-bc8a-490c-ae58-2aedac0b3118', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '155a910bd2e18c8231d190e504ea4770', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=91663) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6ac445-6117-40b4-a8b6-8954fc2be79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e440afe5-9ff8-41b2-b755-3d937730f49c', 'volume_size': 1, 'image_id': '0d211f08-bc8a-490c-ae58-2aedac0b3118', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d211f08-bc8a-490c-ae58-2aedac0b3118', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '155a910bd2e18c8231d190e504ea4770', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d2e54eb06fc440abf5260a4b3d4eeec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0cce21128d7ee1a970d2210ead7a711ae3ada22322f5890da5da6698b0212923e2e8f7b8e4716ee7c48908d1784a4d88fc5f97f6c142d599fba4c4ae7195a524', 'id': '0d211f08-bc8a-490c-ae58-2aedac0b3118', 'created_at': datetime.datetime(2026, 6, 18, 9, 48, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 48, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d211f08-bc8a-490c-ae58-2aedac0b3118/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ffb1a9970>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb271d5-9f55-412b-a8d4-ca6532d9f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:41 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Volume volume-e440afe5-9ff8-41b2-b755-3d937730f49c (e440afe5-9ff8-41b2-b755-3d937730f49c): created successfully
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb271d5-9f55-412b-a8d4-ca6532d9f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Flow 'volume_create_manager' (6a2d6de1-ed89-4340-8a82-5dc2c35cb626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:41 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-a14b93b5-e113-4015-a5e0-77b40a57ff3e tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Created volume successfully.
Jun 18 11:48:41 devstack sudo[110515]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84" returned: 0 in 0.732s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Lock "cinder-quobyte-9c903a62-e98a-4cdb-ac71-a4f85afc0d84" released by "_copy_volume_from_snapshot" :: held 10.012s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Lock "cinder-quobyte-70515794-5bf1-4fee-8255-bf685363f8e5-9c903a62-e98a-4cdb-ac71-a4f85afc0d84" released by "_create_volume_from_snapshot" :: held 10.077s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.112s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.071s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-421146470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a85654a-93ef-4c40-99ae-86b7c5c1259c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6addca7b89cb42b1a336ce55c67e90c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:31Z,use_quota=True,user_id='b5c6d25abf254044805dd2a58670bb22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Creating volume 0a85654a-93ef-4c40-99ae-86b7c5c1259c {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:48:41 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0a85654a-93ef-4c40-99ae-86b7c5c1259c 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:41 devstack sudo[110520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0a85654a-93ef-4c40-99ae-86b7c5c1259c 1073741824
Jun 18 11:48:41 devstack sudo[110520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c3de8d-a836-4bb8-afcd-b950eeb8b895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84', 'volume_size': 1, 'snapshot_id': '70515794-5bf1-4fee-8255-bf685363f8e5'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3fee2e-d7d7-41fc-8c0f-9f1f2fb897cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:41 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Volume volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84 (9c903a62-e98a-4cdb-ac71-a4f85afc0d84): created successfully
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3fee2e-d7d7-41fc-8c0f-9f1f2fb897cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:41 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Flow 'volume_create_manager' (2b527dd7-8caf-40eb-a8c6-0eb7741d13a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:41 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-38fbe33b-b558-4336-a22a-fedd3316829e tempest-VolumeDependencyTests-504466213 None] Created volume successfully.
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] Acquiring lock "cinder-70515794-5bf1-4fee-8255-bf685363f8e5-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] Lock "cinder-70515794-5bf1-4fee-8255-bf685363f8e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] Acquiring lock "cinder-quobyte-334057db-895d-406a-b450-5efc5cf87940" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] Lock "cinder-quobyte-334057db-895d-406a-b450-5efc5cf87940" acquired by "delete_snapshot" :: waited 0.018s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] Acquiring lock "cinder-quobyte-70515794-5bf1-4fee-8255-bf685363f8e5" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] Lock "cinder-quobyte-70515794-5bf1-4fee-8255-bf685363f8e5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] Deleting offline snapshot 70515794-5bf1-4fee-8255-bf685363f8e5 of volume 334057db-895d-406a-b450-5efc5cf87940 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] snapshot_file for this snap is: volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a1df7e-cd78-4aaa-acc7-489927fee959]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:42 devstack sudo[110522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5
Jun 18 11:48:42 devstack sudo[110522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Acquiring lock "cinder-e440afe5-9ff8-41b2-b755-3d937730f49c-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Lock "cinder-e440afe5-9ff8-41b2-b755-3d937730f49c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Acquiring lock "cinder-quobyte-e440afe5-9ff8-41b2-b755-3d937730f49c" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Lock "cinder-quobyte-e440afe5-9ff8-41b2-b755-3d937730f49c" acquired by "delete_volume" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6b7dc4-343a-4a9e-9798-5a284dca221d]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:42 devstack sudo[110527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c
Jun 18 11:48:42 devstack sudo[110527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:42 devstack sudo[110520]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0a85654a-93ef-4c40-99ae-86b7c5c1259c 1073741824" returned: 0 in 0.954s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0a85654a-93ef-4c40-99ae-86b7c5c1259c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:42 devstack sudo[110530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0a85654a-93ef-4c40-99ae-86b7c5c1259c
Jun 18 11:48:42 devstack sudo[110530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:43 devstack sudo[110522]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5" returned: 0 in 1.196s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-334057db-895d-406a-b450-5efc5cf87940(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[79129a26-8c23-428a-8994-09784b2469c1]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:43 devstack sudo[110537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940
Jun 18 11:48:43 devstack sudo[110537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:43 devstack sudo[110527]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c" returned: 0 in 1.079s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:43 devstack sudo[110540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c
Jun 18 11:48:43 devstack sudo[110540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:43 devstack sudo[110530]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0a85654a-93ef-4c40-99ae-86b7c5c1259c" returned: 0 in 0.968s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.657s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1570771544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a594c749-8306-42db-9d8c-082d4f6c6c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6addca7b89cb42b1a336ce55c67e90c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:31Z,use_quota=True,user_id='b5c6d25abf254044805dd2a58670bb22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Creating volume a594c749-8306-42db-9d8c-082d4f6c6c49 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:48:43 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a594c749-8306-42db-9d8c-082d4f6c6c49 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d14f87-6509-44bd-93ed-20b807834609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a85654a-93ef-4c40-99ae-86b7c5c1259c', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:43 devstack sudo[110542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a594c749-8306-42db-9d8c-082d4f6c6c49 1073741824
Jun 18 11:48:43 devstack sudo[110542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a10366-70ae-4123-a8fe-c76c2fd246cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:43 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume volume-0a85654a-93ef-4c40-99ae-86b7c5c1259c (0a85654a-93ef-4c40-99ae-86b7c5c1259c): created successfully
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a10366-70ae-4123-a8fe-c76c2fd246cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Flow 'volume_create_manager' (40f1c9f2-7ba3-4574-803e-ed1b2078288b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:43 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-22a72a82-bce7-4cc1-8b7e-e0418603d811 tempest-CreateVolumesFromSnapshotTest-949316328 None] Created volume successfully.
Jun 18 11:48:44 devstack sudo[110540]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c" returned: 1 in 0.905s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:48:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:44 devstack sudo[110537]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940" returned: 0 in 1.109s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:44 devstack sudo[110550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c
Jun 18 11:48:44 devstack sudo[110550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:44 devstack sudo[110552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5
Jun 18 11:48:44 devstack sudo[110552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:45 devstack sudo[110542]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a594c749-8306-42db-9d8c-082d4f6c6c49 1073741824" returned: 0 in 1.463s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a594c749-8306-42db-9d8c-082d4f6c6c49 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:45 devstack sudo[110561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a594c749-8306-42db-9d8c-082d4f6c6c49
Jun 18 11:48:45 devstack sudo[110561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:45 devstack sudo[110550]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e440afe5-9ff8-41b2-b755-3d937730f49c" returned: 0 in 1.005s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:45 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Lock "cinder-quobyte-e440afe5-9ff8-41b2-b755-3d937730f49c" released by "delete_volume" :: held 3.079s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:45 devstack sudo[110552]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5" returned: 0 in 1.047s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:45 devstack sudo[110563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5
Jun 18 11:48:45 devstack sudo[110563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:45 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Created reservations ['0862edbc-e6bc-4d95-a707-5434738be7b2', '799f4528-c672-466f-9f3c-efd917e5d89f', '57d9852d-022c-442b-bf76-238cfdb9e60c', '8e1c7b5a-31d3-49ca-ba5f-52ad0ee6441b'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:48:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:45 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:45 devstack sudo[110565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:48:45 devstack sudo[110565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:46 devstack sudo[110561]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a594c749-8306-42db-9d8c-082d4f6c6c49" returned: 0 in 1.056s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] <== create_volume: return (2586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.592s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.942s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1887511706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79535130-03e7-49ba-9cea-25828bef196a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6addca7b89cb42b1a336ce55c67e90c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:31Z,use_quota=True,user_id='b5c6d25abf254044805dd2a58670bb22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Creating volume 79535130-03e7-49ba-9cea-25828bef196a {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:48:46 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79535130-03e7-49ba-9cea-25828bef196a 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:46 devstack sudo[110563]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c568a1e1-e6f2-4c82-8997-7a2dc101051e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a594c749-8306-42db-9d8c-082d4f6c6c49', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:46 devstack sudo[110570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79535130-03e7-49ba-9cea-25828bef196a 1073741824
Jun 18 11:48:46 devstack sudo[110570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5cb2624-2b2a-4668-9172-b37554a533f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940.70515794-5bf1-4fee-8255-bf685363f8e5" returned: 0 in 0.908s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:46 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume volume-a594c749-8306-42db-9d8c-082d4f6c6c49 (a594c749-8306-42db-9d8c-082d4f6c6c49): created successfully
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5cb2624-2b2a-4668-9172-b37554a533f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Flow 'volume_create_manager' (a8a2f0fc-ae50-43e5-b16c-cc6bd8c9f9f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] Lock "cinder-quobyte-70515794-5bf1-4fee-8255-bf685363f8e5" released by "_delete_snapshot" :: held 4.415s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:46 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-e640777a-48ee-487d-ac91-06bdbe49cd5d tempest-CreateVolumesFromSnapshotTest-949316328 None] Created volume successfully.
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] Lock "cinder-quobyte-334057db-895d-406a-b450-5efc5cf87940" released by "delete_snapshot" :: held 4.454s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:46 devstack sudo[110565]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.791s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:48:46 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Deleted volume successfully.
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6ebba251-15fe-4e97-a52c-f68fc065b43f tempest-VolumeAndVolumeTypeFromImageTest-1370196339 None] Lock "cinder-e440afe5-9ff8-41b2-b755-3d937730f49c-delete_volume" released by "delete_volume" :: held 4.296s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] Created reservations ['83085622-9340-476e-ae8f-7e203709b5c9', '60cfa041-30d2-4a33-b1d5-12c1db029f2f', '475e1f4b-cfe8-43ed-ab71-9743d1f495c2', '827118d8-2f5f-4d8f-bfea-6c68e4eb2cdb'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:48:46 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] Delete snapshot completed successfully.
Jun 18 11:48:46 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-e43809ac-629e-48a0-b8a1-eae52d481063 tempest-VolumeDependencyTests-504466213 None] Lock "cinder-70515794-5bf1-4fee-8255-bf685363f8e5-delete_snapshot" released by "delete_snapshot" :: held 4.683s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] Acquiring lock "cinder-334057db-895d-406a-b450-5efc5cf87940-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:47 devstack sudo[110570]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79535130-03e7-49ba-9cea-25828bef196a 1073741824" returned: 0 in 1.206s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] Lock "cinder-334057db-895d-406a-b450-5efc5cf87940-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79535130-03e7-49ba-9cea-25828bef196a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] Acquiring lock "cinder-quobyte-334057db-895d-406a-b450-5efc5cf87940" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:47 devstack sudo[110576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79535130-03e7-49ba-9cea-25828bef196a
Jun 18 11:48:47 devstack sudo[110576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:47 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] Lock "cinder-quobyte-334057db-895d-406a-b450-5efc5cf87940" acquired by "delete_volume" :: waited 0.057s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:47 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d052ae0-66f2-4b4e-a24e-542ee45340a2]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:48 devstack sudo[110578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940
Jun 18 11:48:48 devstack sudo[110578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:48 devstack sudo[110576]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79535130-03e7-49ba-9cea-25828bef196a" returned: 0 in 0.749s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.434s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-601225898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b20c2a-5c45-4b34-abfe-32a349902e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6addca7b89cb42b1a336ce55c67e90c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:32Z,use_quota=True,user_id='b5c6d25abf254044805dd2a58670bb22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Creating volume 96b20c2a-5c45-4b34-abfe-32a349902e37 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:48:48 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-96b20c2a-5c45-4b34-abfe-32a349902e37 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:48 devstack sudo[110581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-96b20c2a-5c45-4b34-abfe-32a349902e37 1073741824
Jun 18 11:48:48 devstack sudo[110581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2636c551-fdee-4ff8-a5eb-655f8526d678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79535130-03e7-49ba-9cea-25828bef196a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fed97e-32d0-4ea2-9c89-0007fe3bf34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:48 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume volume-79535130-03e7-49ba-9cea-25828bef196a (79535130-03e7-49ba-9cea-25828bef196a): created successfully
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fed97e-32d0-4ea2-9c89-0007fe3bf34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Flow 'volume_create_manager' (ea6fe8bb-c265-44c9-b0b1-0872aad8a155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:48 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-253453a5-5788-4dd2-9fcd-a3fcb5f8656f tempest-CreateVolumesFromSnapshotTest-949316328 None] Created volume successfully.
Jun 18 11:48:48 devstack sudo[110578]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940" returned: 0 in 1.003s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:48 devstack sudo[110587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940
Jun 18 11:48:48 devstack sudo[110587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:49 devstack sudo[110581]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-96b20c2a-5c45-4b34-abfe-32a349902e37 1073741824" returned: 0 in 1.170s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-96b20c2a-5c45-4b34-abfe-32a349902e37 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:49 devstack sudo[110587]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-334057db-895d-406a-b450-5efc5cf87940" returned: 0 in 0.799s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:49 devstack sudo[110594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-96b20c2a-5c45-4b34-abfe-32a349902e37
Jun 18 11:48:49 devstack sudo[110594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:49 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] Lock "cinder-quobyte-334057db-895d-406a-b450-5efc5cf87940" released by "delete_volume" :: held 1.947s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:49 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] Created reservations ['2ff92778-e1ae-4a1f-9875-a6d3b0eaaa2e', 'c19ab092-f454-407d-a739-3164a3114e00', '97b062ab-b683-4f40-847b-b1f106b45537', '850d2632-6484-4528-ace8-ad59453b8ad9'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:48:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:49 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:49 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:50 devstack sudo[110597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:48:50 devstack sudo[110597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:50 devstack sudo[110594]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-96b20c2a-5c45-4b34-abfe-32a349902e37" returned: 0 in 0.916s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.295s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1689878247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c49a729-deb9-4d13-8d6a-a60080424ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6addca7b89cb42b1a336ce55c67e90c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:32Z,use_quota=True,user_id='b5c6d25abf254044805dd2a58670bb22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Creating volume 4c49a729-deb9-4d13-8d6a-a60080424ec9 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:48:50 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c49a729-deb9-4d13-8d6a-a60080424ec9 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f69f24-ab20-4a64-9092-1e37ddf04a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96b20c2a-5c45-4b34-abfe-32a349902e37', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b057b8-cb18-4031-bda4-4adddb2174ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:50 devstack sudo[110600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c49a729-deb9-4d13-8d6a-a60080424ec9 1073741824
Jun 18 11:48:50 devstack sudo[110600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:50 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume volume-96b20c2a-5c45-4b34-abfe-32a349902e37 (96b20c2a-5c45-4b34-abfe-32a349902e37): created successfully
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b057b8-cb18-4031-bda4-4adddb2174ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Flow 'volume_create_manager' (1456b007-37f6-497a-a41f-dd39c5838b26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:50 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-aecf7722-b870-411c-9e8d-4b9b88ab8dbe tempest-CreateVolumesFromSnapshotTest-949316328 None] Created volume successfully.
Jun 18 11:48:50 devstack sudo[110597]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.921s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:48:50 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] Deleted volume successfully.
Jun 18 11:48:50 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-4fa2e81a-b748-4b2f-8d9c-e9e7bf8ef797 tempest-VolumeDependencyTests-504466213 None] Lock "cinder-334057db-895d-406a-b450-5efc5cf87940-delete_volume" released by "delete_volume" :: held 3.285s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] Acquiring lock "cinder-9c903a62-e98a-4cdb-ac71-a4f85afc0d84-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] Lock "cinder-9c903a62-e98a-4cdb-ac71-a4f85afc0d84-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] Acquiring lock "cinder-quobyte-9c903a62-e98a-4cdb-ac71-a4f85afc0d84" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:51 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] Lock "cinder-quobyte-9c903a62-e98a-4cdb-ac71-a4f85afc0d84" acquired by "delete_volume" :: waited 0.027s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:51 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ceb9c3-a312-4a39-84a4-ff2cd80b605a]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:51 devstack sudo[110603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84
Jun 18 11:48:51 devstack sudo[110603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:51 devstack sudo[110600]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c49a729-deb9-4d13-8d6a-a60080424ec9 1073741824" returned: 0 in 1.099s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c49a729-deb9-4d13-8d6a-a60080424ec9 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:51 devstack sudo[110610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c49a729-deb9-4d13-8d6a-a60080424ec9
Jun 18 11:48:51 devstack sudo[110610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:52 devstack sudo[110603]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84" returned: 0 in 1.003s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:52 devstack sudo[110615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84
Jun 18 11:48:52 devstack sudo[110615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:52 devstack sudo[110610]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c49a729-deb9-4d13-8d6a-a60080424ec9" returned: 0 in 0.827s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:48:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88875c00-9465-4a5e-ade0-713c30b4ee02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c49a729-deb9-4d13-8d6a-a60080424ec9', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19c1257-7c48-4247-ae59-32f1464f6b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:52 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Volume volume-4c49a729-deb9-4d13-8d6a-a60080424ec9 (4c49a729-deb9-4d13-8d6a-a60080424ec9): created successfully
Jun 18 11:48:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19c1257-7c48-4247-ae59-32f1464f6b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:52 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Flow 'volume_create_manager' (dfea15cc-d05a-4514-9646-da51c68ff4ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:52 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-75f35cdf-f675-4bfc-b327-30596a08965d tempest-CreateVolumesFromSnapshotTest-949316328 None] Created volume successfully.
Jun 18 11:48:52 devstack sudo[110615]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-9c903a62-e98a-4cdb-ac71-a4f85afc0d84" returned: 0 in 0.697s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] Lock "cinder-quobyte-9c903a62-e98a-4cdb-ac71-a4f85afc0d84" released by "delete_volume" :: held 1.760s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] Created reservations ['1101a6cb-39f7-4f95-95b2-542750967455', '36152d70-07b1-4f9e-9507-1a870b4b452e', 'a84b7cff-f56b-4f65-84e0-5850d7b9e8bc', '4f05fe7b-c018-4c0c-8e97-61cb120d7ef7'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:53 devstack sudo[110619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:48:53 devstack sudo[110619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Flow 'volume_create_manager' (703dc963-6dcb-41bc-97c4-e9082b3b7b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71eafe5-4f35-4851-918d-ed1a823cfcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71eafe5-4f35-4851-918d-ed1a823cfcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-787133696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d841d1f-484d-47bc-a8a5-bdbdfa0cc121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea37d78ccae943cead7365ee72b6afbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:53Z,use_quota=True,user_id='8d0ee2154dae4cfdb9f1691e4138284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddeab24f-4d57-40f2-8781-c476f433a7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddeab24f-4d57-40f2-8781-c476f433a7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66302096-583e-45d8-8650-be0bda8b5a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66302096-583e-45d8-8650-be0bda8b5a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d841d1f-484d-47bc-a8a5-bdbdfa0cc121', 'volume_name': 'volume-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7e39f9-f2ca-4abd-9679-44658bbae7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7e39f9-f2ca-4abd-9679-44658bbae7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a281d718-50a9-4b3b-ace9-a7b923393ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:53 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume 3d841d1f-484d-47bc-a8a5-bdbdfa0cc121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121', 'volume_size': 1}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-787133696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d841d1f-484d-47bc-a8a5-bdbdfa0cc121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea37d78ccae943cead7365ee72b6afbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:53Z,use_quota=True,user_id='8d0ee2154dae4cfdb9f1691e4138284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Creating volume 3d841d1f-484d-47bc-a8a5-bdbdfa0cc121 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:48:53 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:53 devstack sudo[110621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121 1073741824
Jun 18 11:48:53 devstack sudo[110621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "cinder-4c49a729-deb9-4d13-8d6a-a60080424ec9-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-4c49a729-deb9-4d13-8d6a-a60080424ec9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "cinder-quobyte-4c49a729-deb9-4d13-8d6a-a60080424ec9" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:53 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-quobyte-4c49a729-deb9-4d13-8d6a-a60080424ec9" acquired by "delete_volume" :: waited 0.023s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:54 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e9b585-3fcc-4f32-b66f-3063468df0fb]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c49a729-deb9-4d13-8d6a-a60080424ec9 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:54 devstack sudo[110619]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.034s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:54 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:48:54 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] Deleted volume successfully.
Jun 18 11:48:54 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-feec5f2a-48aa-4a8a-8817-0a7a65f99c9d tempest-VolumeDependencyTests-504466213 None] Lock "cinder-9c903a62-e98a-4cdb-ac71-a4f85afc0d84-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:54 devstack sudo[110624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c49a729-deb9-4d13-8d6a-a60080424ec9
Jun 18 11:48:54 devstack sudo[110624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:54 devstack sudo[110621]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121 1073741824" returned: 0 in 1.233s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:54 devstack sudo[110630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121
Jun 18 11:48:54 devstack sudo[110630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:55 devstack sudo[110624]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c49a729-deb9-4d13-8d6a-a60080424ec9" returned: 0 in 1.093s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c49a729-deb9-4d13-8d6a-a60080424ec9 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:55 devstack sudo[110636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c49a729-deb9-4d13-8d6a-a60080424ec9
Jun 18 11:48:55 devstack sudo[110636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:55 devstack sudo[110630]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121" returned: 0 in 0.815s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:55 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] <== create_volume: return (2134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:48:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.137s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:55 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a281d718-50a9-4b3b-ace9-a7b923393ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:55 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfa0589-d9fd-4a93-acb3-0db762447e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:55 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume volume-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121 (3d841d1f-484d-47bc-a8a5-bdbdfa0cc121): created successfully
Jun 18 11:48:55 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfa0589-d9fd-4a93-acb3-0db762447e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:55 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Flow 'volume_create_manager' (703dc963-6dcb-41bc-97c4-e9082b3b7b61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:55 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-25c1d913-9762-4c47-a133-65f8297271d2 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Created volume successfully.
Jun 18 11:48:56 devstack sudo[110636]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-4c49a729-deb9-4d13-8d6a-a60080424ec9" returned: 0 in 0.991s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:56 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-quobyte-4c49a729-deb9-4d13-8d6a-a60080424ec9" released by "delete_volume" :: held 2.139s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:56 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] Created reservations ['7128e55f-9b7d-48ee-aff5-a437fddaefe2', 'f75f22c4-ccef-414e-8185-41b3e21d621f', 'a4045d97-220c-4ffb-a0e0-abba708b6ed3', '301c4c06-4b7d-42dc-9f86-574eae914779'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:48:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:56 devstack sudo[110641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:48:56 devstack sudo[110641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:56 devstack sudo[110641]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.728s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:56 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:48:57 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] Deleted volume successfully.
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Flow 'volume_create_manager' (319f1224-ed7d-4577-b0ec-fdb6ba5a9fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730aed19-1609-4cce-987d-a71b875b6fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-a4ba48ce-f72a-4445-a90a-6b64d90d1eef tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-4c49a729-deb9-4d13-8d6a-a60080424ec9-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730aed19-1609-4cce-987d-a71b875b6fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-937045403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870d118f-bd50-4d39-bb79-3a5b931ee6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea37d78ccae943cead7365ee72b6afbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:57Z,use_quota=True,user_id='8d0ee2154dae4cfdb9f1691e4138284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b61ac94-4e96-4d3d-bd17-30937e4b8118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b61ac94-4e96-4d3d-bd17-30937e4b8118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2077e683-13f1-407d-b76c-e199841136dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2077e683-13f1-407d-b76c-e199841136dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '870d118f-bd50-4d39-bb79-3a5b931ee6df', 'volume_name': 'volume-870d118f-bd50-4d39-bb79-3a5b931ee6df', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3841fda1-0c46-4efc-901f-1b6f66c68a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3841fda1-0c46-4efc-901f-1b6f66c68a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45dc942-9834-4021-8824-041f3398525a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:57 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume 870d118f-bd50-4d39-bb79-3a5b931ee6df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-870d118f-bd50-4d39-bb79-3a5b931ee6df', 'volume_size': 1}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-937045403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870d118f-bd50-4d39-bb79-3a5b931ee6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea37d78ccae943cead7365ee72b6afbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:57Z,use_quota=True,user_id='8d0ee2154dae4cfdb9f1691e4138284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Creating volume 870d118f-bd50-4d39-bb79-3a5b931ee6df {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:48:57 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-870d118f-bd50-4d39-bb79-3a5b931ee6df 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:57 devstack sudo[110644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-870d118f-bd50-4d39-bb79-3a5b931ee6df 1073741824
Jun 18 11:48:57 devstack sudo[110644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "cinder-96b20c2a-5c45-4b34-abfe-32a349902e37-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-96b20c2a-5c45-4b34-abfe-32a349902e37-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "cinder-quobyte-96b20c2a-5c45-4b34-abfe-32a349902e37" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-quobyte-96b20c2a-5c45-4b34-abfe-32a349902e37" acquired by "delete_volume" :: waited 0.039s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ade1d7-7426-4e91-b188-7586c10ca69c]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-96b20c2a-5c45-4b34-abfe-32a349902e37 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Flow 'volume_create_manager' (b8748cfa-ee8b-4a1a-8962-060e2f4a9bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889b9f18-daca-4590-8d21-830de6345c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889b9f18-daca-4590-8d21-830de6345c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99947192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d316a4-5428-4de9-ae1f-42b3e9064dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea37d78ccae943cead7365ee72b6afbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:57Z,use_quota=True,user_id='8d0ee2154dae4cfdb9f1691e4138284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf949958-ce4f-48c3-9f45-4672024a7240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf949958-ce4f-48c3-9f45-4672024a7240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a85614-5f13-4abc-939f-ef320f1555a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a85614-5f13-4abc-939f-ef320f1555a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4d316a4-5428-4de9-ae1f-42b3e9064dc4', 'volume_name': 'volume-e4d316a4-5428-4de9-ae1f-42b3e9064dc4', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c41326-f302-4d84-a443-043ede186904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c41326-f302-4d84-a443-043ede186904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e048b504-6d27-4baa-ba28-4c0d9dac83aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:57 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume e4d316a4-5428-4de9-ae1f-42b3e9064dc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4d316a4-5428-4de9-ae1f-42b3e9064dc4', 'volume_size': 1}
Jun 18 11:48:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:57 devstack sudo[110646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-96b20c2a-5c45-4b34-abfe-32a349902e37
Jun 18 11:48:57 devstack sudo[110646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Flow 'volume_create_manager' (e6769e7f-b04c-43ba-9535-ed10b2bc74df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061d5b65-5258-4cc9-af2b-9b3f33e203f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061d5b65-5258-4cc9-af2b-9b3f33e203f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-821603679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b51645b-fa83-419f-9467-a375077c251a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea37d78ccae943cead7365ee72b6afbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:58Z,use_quota=True,user_id='8d0ee2154dae4cfdb9f1691e4138284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b524b95e-0178-446b-8a3a-8427126eead4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b524b95e-0178-446b-8a3a-8427126eead4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e2985b-f995-4a42-8cf5-9d81143393fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e2985b-f995-4a42-8cf5-9d81143393fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b51645b-fa83-419f-9467-a375077c251a', 'volume_name': 'volume-2b51645b-fa83-419f-9467-a375077c251a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a411e8db-cc99-4520-994f-84ed424b307f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a411e8db-cc99-4520-994f-84ed424b307f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bce9ceb-c55a-40ee-9ce3-2cbba0d96b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:58 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume 2b51645b-fa83-419f-9467-a375077c251a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b51645b-fa83-419f-9467-a375077c251a', 'volume_size': 1}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:58 devstack sudo[110644]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-870d118f-bd50-4d39-bb79-3a5b931ee6df 1073741824" returned: 0 in 1.382s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-870d118f-bd50-4d39-bb79-3a5b931ee6df {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:58 devstack sudo[110655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-870d118f-bd50-4d39-bb79-3a5b931ee6df
Jun 18 11:48:58 devstack sudo[110655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:58 devstack sudo[110646]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-96b20c2a-5c45-4b34-abfe-32a349902e37" returned: 0 in 1.240s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-96b20c2a-5c45-4b34-abfe-32a349902e37 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:58 devstack sudo[110657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-96b20c2a-5c45-4b34-abfe-32a349902e37
Jun 18 11:48:58 devstack sudo[110657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Flow 'volume_create_manager' (76ac2af9-d023-484e-aff2-55488e82c5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570b5a13-c1a5-4c25-baf4-18ab3cb8bfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570b5a13-c1a5-4c25-baf4-18ab3cb8bfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-571871712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce7828a-1a08-4ee2-ac2f-bc1ce4149441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea37d78ccae943cead7365ee72b6afbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:59Z,use_quota=True,user_id='8d0ee2154dae4cfdb9f1691e4138284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faaa1f94-d34d-46a8-84ca-54f71ef5e644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faaa1f94-d34d-46a8-84ca-54f71ef5e644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9c5be1-be72-4822-a5bf-2fed9946eb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9c5be1-be72-4822-a5bf-2fed9946eb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce7828a-1a08-4ee2-ac2f-bc1ce4149441', 'volume_name': 'volume-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a882329-339e-48b5-9219-054112fdc736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:58 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a882329-339e-48b5-9219-054112fdc736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b36223-6dbf-46ed-b05a-9a86551b8082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:59 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume 8ce7828a-1a08-4ee2-ac2f-bc1ce4149441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441', 'volume_size': 1}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Flow 'volume_create_manager' (63e83f27-42d8-4a57-943c-34151fc4dfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76406f7f-dab9-473c-afef-1bf064ace0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76406f7f-dab9-473c-afef-1bf064ace0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-88650212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6629e85c-3a82-455b-90bd-85bcff5f027c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea37d78ccae943cead7365ee72b6afbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:59Z,use_quota=True,user_id='8d0ee2154dae4cfdb9f1691e4138284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67afd52c-59df-4a39-b91d-966597384878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67afd52c-59df-4a39-b91d-966597384878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4dd870c-e1d0-44b7-a4a8-758d98e6243c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4dd870c-e1d0-44b7-a4a8-758d98e6243c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6629e85c-3a82-455b-90bd-85bcff5f027c', 'volume_name': 'volume-6629e85c-3a82-455b-90bd-85bcff5f027c', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d60c7d4-fe42-419d-9022-0d663504b386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d60c7d4-fe42-419d-9022-0d663504b386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5cece07-2b6a-4f00-98c8-ddbd22295688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:59 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume 6629e85c-3a82-455b-90bd-85bcff5f027c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6629e85c-3a82-455b-90bd-85bcff5f027c', 'volume_size': 1}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:59 devstack sudo[110657]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-96b20c2a-5c45-4b34-abfe-32a349902e37" returned: 0 in 0.827s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-quobyte-96b20c2a-5c45-4b34-abfe-32a349902e37" released by "delete_volume" :: held 2.151s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:48:59 devstack sudo[110655]: pam_unix(sudo:session): session closed for user root
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-870d118f-bd50-4d39-bb79-3a5b931ee6df" returned: 0 in 1.066s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] <== create_volume: return (2555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.558s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.951s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99947192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d316a4-5428-4de9-ae1f-42b3e9064dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea37d78ccae943cead7365ee72b6afbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:57Z,use_quota=True,user_id='8d0ee2154dae4cfdb9f1691e4138284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Creating volume e4d316a4-5428-4de9-ae1f-42b3e9064dc4 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:48:59 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e4d316a4-5428-4de9-ae1f-42b3e9064dc4 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:59 devstack sudo[110661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e4d316a4-5428-4de9-ae1f-42b3e9064dc4 1073741824
Jun 18 11:48:59 devstack sudo[110661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] Created reservations ['23c2096f-12cd-4900-8276-4144d958a380', 'a299af21-0442-4ffd-9a46-5b8062c7c9ae', 'c4502469-bb9d-4bd8-9ba9-98a951d9c220', 'a8ff7a9e-88f0-4e82-a76e-ad2077b45ede'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45dc942-9834-4021-8824-041f3398525a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-870d118f-bd50-4d39-bb79-3a5b931ee6df', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6047c608-a0d1-435a-b339-793448d64b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:48:59 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume volume-870d118f-bd50-4d39-bb79-3a5b931ee6df (870d118f-bd50-4d39-bb79-3a5b931ee6df): created successfully
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6047c608-a0d1-435a-b339-793448d64b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Flow 'volume_create_manager' (319f1224-ed7d-4577-b0ec-fdb6ba5a9fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:48:59 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-2f7be5cc-e88a-49bb-b196-a46f841cf523 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Created volume successfully.
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:48:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:48:59 devstack sudo[110663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:48:59 devstack sudo[110663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:00 devstack sudo[110663]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.691s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:00 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:49:00 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] Deleted volume successfully.
Jun 18 11:49:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-6f6f2c4e-74dd-40f5-9edf-d436f720929a tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-96b20c2a-5c45-4b34-abfe-32a349902e37-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:00 devstack sudo[110661]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e4d316a4-5428-4de9-ae1f-42b3e9064dc4 1073741824" returned: 0 in 0.982s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e4d316a4-5428-4de9-ae1f-42b3e9064dc4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:00 devstack sudo[110672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e4d316a4-5428-4de9-ae1f-42b3e9064dc4
Jun 18 11:49:00 devstack sudo[110672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "cinder-79535130-03e7-49ba-9cea-25828bef196a-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-79535130-03e7-49ba-9cea-25828bef196a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "cinder-quobyte-79535130-03e7-49ba-9cea-25828bef196a" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:00 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-quobyte-79535130-03e7-49ba-9cea-25828bef196a" acquired by "delete_volume" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:00 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[b238af83-5908-47ff-8650-205eeef97b3d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:00 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79535130-03e7-49ba-9cea-25828bef196a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:01 devstack sudo[110674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79535130-03e7-49ba-9cea-25828bef196a
Jun 18 11:49:01 devstack sudo[110674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e4d316a4-5428-4de9-ae1f-42b3e9064dc4" returned: 0 in 0.721s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:01 devstack sudo[110672]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.184s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-821603679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b51645b-fa83-419f-9467-a375077c251a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea37d78ccae943cead7365ee72b6afbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:58Z,use_quota=True,user_id='8d0ee2154dae4cfdb9f1691e4138284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Creating volume 2b51645b-fa83-419f-9467-a375077c251a {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:49:01 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2b51645b-fa83-419f-9467-a375077c251a 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e048b504-6d27-4baa-ba28-4c0d9dac83aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d316a4-5428-4de9-ae1f-42b3e9064dc4', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a04f0e3-15c7-494d-8a28-c65e324378d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:01 devstack sudo[110677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2b51645b-fa83-419f-9467-a375077c251a 1073741824
Jun 18 11:49:01 devstack sudo[110677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:01 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume volume-e4d316a4-5428-4de9-ae1f-42b3e9064dc4 (e4d316a4-5428-4de9-ae1f-42b3e9064dc4): created successfully
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a04f0e3-15c7-494d-8a28-c65e324378d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Flow 'volume_create_manager' (b8748cfa-ee8b-4a1a-8962-060e2f4a9bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:49:01 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-99231d1d-19a6-4ab9-a93b-ec1e93566a3b tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Created volume successfully.
Jun 18 11:49:01 devstack sudo[110674]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79535130-03e7-49ba-9cea-25828bef196a" returned: 0 in 0.856s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:01 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79535130-03e7-49ba-9cea-25828bef196a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:01 devstack sudo[110682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79535130-03e7-49ba-9cea-25828bef196a
Jun 18 11:49:01 devstack sudo[110682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:02 devstack sudo[110677]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2b51645b-fa83-419f-9467-a375077c251a 1073741824" returned: 0 in 0.956s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2b51645b-fa83-419f-9467-a375077c251a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:02 devstack sudo[110682]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-79535130-03e7-49ba-9cea-25828bef196a" returned: 0 in 0.720s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:02 devstack sudo[110689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2b51645b-fa83-419f-9467-a375077c251a
Jun 18 11:49:02 devstack sudo[110689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:02 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-quobyte-79535130-03e7-49ba-9cea-25828bef196a" released by "delete_volume" :: held 1.633s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:02 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] Created reservations ['66579d8c-c5d9-4c89-9089-8eaa1a3ac8d7', '884cefa6-4b9e-47bb-8e65-e67605d9a1dc', '1ccfe84a-7901-44c3-8dd3-bd28d6dbdfb5', '1da4362c-9f6a-42fd-8e6b-b9450683197d'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:02 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:02 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:02 devstack sudo[110691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:49:02 devstack sudo[110691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "cinder-a594c749-8306-42db-9d8c-082d4f6c6c49-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-a594c749-8306-42db-9d8c-082d4f6c6c49-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "cinder-quobyte-a594c749-8306-42db-9d8c-082d4f6c6c49" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-quobyte-a594c749-8306-42db-9d8c-082d4f6c6c49" acquired by "delete_volume" :: waited 0.025s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bfabeb-cdee-4976-b67b-390b3618f00d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a594c749-8306-42db-9d8c-082d4f6c6c49 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:03 devstack sudo[110691]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.777s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:49:03 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] Deleted volume successfully.
Jun 18 11:49:03 devstack sudo[110689]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:03 devstack sudo[110697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a594c749-8306-42db-9d8c-082d4f6c6c49
Jun 18 11:49:03 devstack sudo[110697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2b51645b-fa83-419f-9467-a375077c251a" returned: 0 in 0.978s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] <== create_volume: return (1993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.457s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-571871712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce7828a-1a08-4ee2-ac2f-bc1ce4149441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea37d78ccae943cead7365ee72b6afbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:59Z,use_quota=True,user_id='8d0ee2154dae4cfdb9f1691e4138284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Creating volume 8ce7828a-1a08-4ee2-ac2f-bc1ce4149441 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:49:03 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bce9ceb-c55a-40ee-9ce3-2cbba0d96b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b51645b-fa83-419f-9467-a375077c251a', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:03 devstack sudo[110699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441 1073741824
Jun 18 11:49:03 devstack sudo[110699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf763227-d32a-434d-a961-997ff61deb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-632f7241-037b-41ac-a212-8c8ce039fcff tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-79535130-03e7-49ba-9cea-25828bef196a-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:03 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume volume-2b51645b-fa83-419f-9467-a375077c251a (2b51645b-fa83-419f-9467-a375077c251a): created successfully
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf763227-d32a-434d-a961-997ff61deb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:03 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Flow 'volume_create_manager' (e6769e7f-b04c-43ba-9535-ed10b2bc74df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:49:03 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-6e5303ed-bcc0-4252-ab4b-d67d1d3bf8ff tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Created volume successfully.
Jun 18 11:49:04 devstack sudo[110697]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a594c749-8306-42db-9d8c-082d4f6c6c49" returned: 0 in 0.861s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a594c749-8306-42db-9d8c-082d4f6c6c49 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:04 devstack sudo[110707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a594c749-8306-42db-9d8c-082d4f6c6c49
Jun 18 11:49:04 devstack sudo[110707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:04 devstack sudo[110699]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441 1073741824" returned: 0 in 1.026s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Flow 'volume_create_manager' (f5241408-c782-44db-8fc1-606c8308a7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9a0cbf-3337-4983-a8b5-458a2fa788fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9a0cbf-3337-4983-a8b5-458a2fa788fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1211054888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84aa241d-4683-427c-a56c-0e7969be9f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7a1ca9f0e04c8cbdc0d620adb1003e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:49:04Z,use_quota=True,user_id='7ab5398d07604bfeaa81f3f280dc1ec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e347fd-e685-4778-8a8d-0a4e7c747a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e347fd-e685-4778-8a8d-0a4e7c747a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e4e8b3-dfef-4239-8df1-9bb9410f29f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e4e8b3-dfef-4239-8df1-9bb9410f29f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84aa241d-4683-427c-a56c-0e7969be9f99', 'volume_name': 'volume-84aa241d-4683-427c-a56c-0e7969be9f99', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0df2d08-1ea8-4cf3-a58e-8d77c7a97c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0df2d08-1ea8-4cf3-a58e-8d77c7a97c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8851d531-1e35-43a8-8474-725718d69472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:04 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Volume 84aa241d-4683-427c-a56c-0e7969be9f99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84aa241d-4683-427c-a56c-0e7969be9f99', 'volume_size': 1}
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:04 devstack sudo[110710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441
Jun 18 11:49:04 devstack sudo[110710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:04 devstack sudo[110707]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a594c749-8306-42db-9d8c-082d4f6c6c49" returned: 0 in 0.719s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-quobyte-a594c749-8306-42db-9d8c-082d4f6c6c49" released by "delete_volume" :: held 1.637s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:04 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] Created reservations ['df53e999-5bea-417f-94a4-919270eb7398', '6c7b5f1b-716c-40be-b0bd-606730ed98c7', '9e40a084-8b19-489f-ae67-0c1a021c67a4', '63606043-581f-41ae-83e8-b4272393b9fc'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:05 devstack sudo[110713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:49:05 devstack sudo[110713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:05 devstack sudo[110710]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441" returned: 0 in 0.656s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.886s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-88650212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6629e85c-3a82-455b-90bd-85bcff5f027c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea37d78ccae943cead7365ee72b6afbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:48:59Z,use_quota=True,user_id='8d0ee2154dae4cfdb9f1691e4138284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Creating volume 6629e85c-3a82-455b-90bd-85bcff5f027c {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:49:05 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6629e85c-3a82-455b-90bd-85bcff5f027c 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b36223-6dbf-46ed-b05a-9a86551b8082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:05 devstack sudo[110716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6629e85c-3a82-455b-90bd-85bcff5f027c 1073741824
Jun 18 11:49:05 devstack sudo[110716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0a6710-0ec0-4860-9036-981cfa55546e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:05 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume volume-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441 (8ce7828a-1a08-4ee2-ac2f-bc1ce4149441): created successfully
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0a6710-0ec0-4860-9036-981cfa55546e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Flow 'volume_create_manager' (76ac2af9-d023-484e-aff2-55488e82c5fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:49:05 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-6ee42065-30d2-4178-9b16-52e04cacbce5 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Created volume successfully.
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "cinder-0a85654a-93ef-4c40-99ae-86b7c5c1259c-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-0a85654a-93ef-4c40-99ae-86b7c5c1259c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "cinder-quobyte-0a85654a-93ef-4c40-99ae-86b7c5c1259c" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-quobyte-0a85654a-93ef-4c40-99ae-86b7c5c1259c" acquired by "delete_volume" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f11d300-4d20-404f-80ea-2d2b578bb251]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0a85654a-93ef-4c40-99ae-86b7c5c1259c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:05 devstack sudo[110718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0a85654a-93ef-4c40-99ae-86b7c5c1259c
Jun 18 11:49:05 devstack sudo[110718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:05 devstack sudo[110713]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.720s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:49:05 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] Deleted volume successfully.
Jun 18 11:49:05 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-36f2f19e-a05c-4a32-aa78-ae21adb7420e tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-a594c749-8306-42db-9d8c-082d4f6c6c49-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:06 devstack sudo[110716]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6629e85c-3a82-455b-90bd-85bcff5f027c 1073741824" returned: 0 in 0.879s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=130,cinder:UPDATE=173,cinder:DELETE=17,cinder:INSERT=34 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6629e85c-3a82-455b-90bd-85bcff5f027c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:06 devstack sudo[110725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6629e85c-3a82-455b-90bd-85bcff5f027c
Jun 18 11:49:06 devstack sudo[110725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:06 devstack sudo[110718]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0a85654a-93ef-4c40-99ae-86b7c5c1259c" returned: 0 in 0.787s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0a85654a-93ef-4c40-99ae-86b7c5c1259c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:06 devstack sudo[110730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0a85654a-93ef-4c40-99ae-86b7c5c1259c
Jun 18 11:49:06 devstack sudo[110730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:06 devstack sudo[110725]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6629e85c-3a82-455b-90bd-85bcff5f027c" returned: 0 in 0.645s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.262s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1211054888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84aa241d-4683-427c-a56c-0e7969be9f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7a1ca9f0e04c8cbdc0d620adb1003e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:49:04Z,use_quota=True,user_id='7ab5398d07604bfeaa81f3f280dc1ec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Creating volume 84aa241d-4683-427c-a56c-0e7969be9f99 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:49:06 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:UPDATE=157,cinder:SELECT=112,cinder:INSERT=49,cinder:DELETE=16 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:49:06 devstack sudo[110733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99 1073741824
Jun 18 11:49:06 devstack sudo[110733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5cece07-2b6a-4f00-98c8-ddbd22295688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6629e85c-3a82-455b-90bd-85bcff5f027c', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f044d2a3-95fb-445f-95e7-656e5d261bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:06 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Volume volume-6629e85c-3a82-455b-90bd-85bcff5f027c (6629e85c-3a82-455b-90bd-85bcff5f027c): created successfully
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f044d2a3-95fb-445f-95e7-656e5d261bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:06 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Flow 'volume_create_manager' (63e83f27-42d8-4a57-943c-34151fc4dfd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:49:06 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-479ed8f2-fdfc-4c30-8692-203e81cf4ca9 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Created volume successfully.
Jun 18 11:49:07 devstack sudo[110730]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-0a85654a-93ef-4c40-99ae-86b7c5c1259c" returned: 0 in 0.673s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-quobyte-0a85654a-93ef-4c40-99ae-86b7c5c1259c" released by "delete_volume" :: held 1.511s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "cinder-6629e85c-3a82-455b-90bd-85bcff5f027c-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-6629e85c-3a82-455b-90bd-85bcff5f027c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] Created reservations ['3da0cb0e-8ed7-465d-9e9e-04c199061687', '0e6e343b-264c-441b-9726-7760637235ef', 'dd15ee45-f125-4d95-b5bf-edb66fe2043f', '0f7b5f21-98f8-41ac-86a3-7c7d56db901c'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "cinder-quobyte-6629e85c-3a82-455b-90bd-85bcff5f027c" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-quobyte-6629e85c-3a82-455b-90bd-85bcff5f027c" acquired by "delete_volume" :: waited 0.027s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[3462cd08-a3f9-46d9-9f5b-7af216ce584d]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6629e85c-3a82-455b-90bd-85bcff5f027c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:07 devstack sudo[110740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:49:07 devstack sudo[110740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:07 devstack sudo[110739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6629e85c-3a82-455b-90bd-85bcff5f027c
Jun 18 11:49:07 devstack sudo[110739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "cinder-34a38c99-f13d-4a96-b633-5ad3f51a3e77-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-34a38c99-f13d-4a96-b633-5ad3f51a3e77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "cinder-quobyte-1e2c4aa5-fa1a-4460-8d09-09a7877471bc" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-quobyte-1e2c4aa5-fa1a-4460-8d09-09a7877471bc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "cinder-quobyte-34a38c99-f13d-4a96-b633-5ad3f51a3e77" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:07 devstack sudo[110733]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99 1073741824" returned: 0 in 0.947s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-quobyte-34a38c99-f13d-4a96-b633-5ad3f51a3e77" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] Deleting offline snapshot 34a38c99-f13d-4a96-b633-5ad3f51a3e77 of volume 1e2c4aa5-fa1a-4460-8d09-09a7877471bc {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] snapshot_file for this snap is: volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c70dbd-4c07-46ff-993f-1923db666e77]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:07 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:07 devstack sudo[110752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99
Jun 18 11:49:07 devstack sudo[110752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:08 devstack sudo[110750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77
Jun 18 11:49:08 devstack sudo[110750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:08 devstack sudo[110740]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.801s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:49:08 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] Deleted volume successfully.
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f31b7022-fdfa-489c-8221-ae5e57f08c17 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-0a85654a-93ef-4c40-99ae-86b7c5c1259c-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:08 devstack sudo[110739]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6629e85c-3a82-455b-90bd-85bcff5f027c" returned: 0 in 0.934s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6629e85c-3a82-455b-90bd-85bcff5f027c {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:08 devstack sudo[110759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6629e85c-3a82-455b-90bd-85bcff5f027c
Jun 18 11:49:08 devstack sudo[110759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:08 devstack sudo[110752]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99" returned: 0 in 0.796s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8851d531-1e35-43a8-8474-725718d69472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84aa241d-4683-427c-a56c-0e7969be9f99', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642c3708-1f15-47c3-9dd5-10b6196ac98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:08 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Volume volume-84aa241d-4683-427c-a56c-0e7969be9f99 (84aa241d-4683-427c-a56c-0e7969be9f99): created successfully
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642c3708-1f15-47c3-9dd5-10b6196ac98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Flow 'volume_create_manager' (f5241408-c782-44db-8fc1-606c8308a7e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:49:08 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-75abb55d-5c48-4e51-af54-2ff1d82a125c tempest-SnapshotDependencyTests-573631136 None] Created volume successfully.
Jun 18 11:49:08 devstack sudo[110750]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77" returned: 0 in 0.912s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[246ef66c-6784-480d-92f1-976c6f0eaf48]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:08 devstack sudo[110765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc
Jun 18 11:49:08 devstack sudo[110765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:08 devstack sudo[110759]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-6629e85c-3a82-455b-90bd-85bcff5f027c" returned: 0 in 0.779s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:08 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-quobyte-6629e85c-3a82-455b-90bd-85bcff5f027c" released by "delete_volume" :: held 1.760s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Created reservations ['170c8d8c-4765-4d1d-aece-4c8f8d4bf3a8', 'bbbbb38e-eac0-4c6f-b522-049d18a8e2a5', 'c9871eb0-ce9b-4403-9ead-7765f773c64b', 'a9ae7aa7-9e47-45af-a4b7-9b2e75552930'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:09 devstack sudo[110768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:49:09 devstack sudo[110768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "cinder-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "cinder-quobyte-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-quobyte-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441" acquired by "delete_volume" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[3282527f-1ad1-441f-a397-fbe617c609ce]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:09 devstack sudo[110765]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc" returned: 0 in 0.822s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:09 devstack sudo[110775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77
Jun 18 11:49:09 devstack sudo[110775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:09 devstack sudo[110774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441
Jun 18 11:49:09 devstack sudo[110774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:09 devstack sudo[110768]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.736s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:49:09 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Deleted volume successfully.
Jun 18 11:49:09 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-66ba757d-4f0d-4fc5-af6d-ea4dcf0621c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-6629e85c-3a82-455b-90bd-85bcff5f027c-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:10 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] Creating offline snapshot 322a9569-edf3-438a-a08d-6ce24c911f79 of volume 84aa241d-4683-427c-a56c-0e7969be9f99 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:49:10 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcd4bf9-a8e8-4f73-82f1-fa669db40543]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:10 devstack sudo[110780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99
Jun 18 11:49:10 devstack sudo[110780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:10 devstack sudo[110774]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441" returned: 0 in 0.847s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:10 devstack sudo[110788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441
Jun 18 11:49:10 devstack sudo[110788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:10 devstack sudo[110775]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77" returned: 0 in 0.816s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:10 devstack sudo[110790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77
Jun 18 11:49:10 devstack sudo[110790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:10 devstack sudo[110780]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99" returned: 0 in 0.832s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:10 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:11 devstack sudo[110796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79 1G
Jun 18 11:49:11 devstack sudo[110796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:11 devstack sudo[110788]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441" returned: 0 in 0.692s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-quobyte-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441" released by "delete_volume" :: held 1.590s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:11 devstack sudo[110790]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc.34a38c99-f13d-4a96-b633-5ad3f51a3e77" returned: 0 in 0.682s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-quobyte-34a38c99-f13d-4a96-b633-5ad3f51a3e77" released by "_delete_snapshot" :: held 3.344s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-quobyte-1e2c4aa5-fa1a-4460-8d09-09a7877471bc" released by "delete_snapshot" :: held 3.378s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Created reservations ['e2f91640-0cb7-4249-b13e-4fcecc8446b4', '1e5a1703-331a-4d71-8d0f-5a75360c487f', '24c8f54d-9614-4f0c-a940-e0310e427aa0', '51f3e2d3-21c5-4236-9e93-21ac79e99d8c'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] Created reservations ['b53e2f07-c353-4782-b7b8-9d83e448aa3e', 'dd8ce89f-122a-4a94-8ac5-984b6adca565', '184ff985-4263-4cf5-8ffe-051d9cf2a449', 'fa852014-a90f-4fd3-bb25-29a2ad474920'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:11 devstack sudo[110799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:49:11 devstack sudo[110799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:11 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] Delete snapshot completed successfully.
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8f02665a-b455-4e37-a8c7-19d55c645753 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-34a38c99-f13d-4a96-b633-5ad3f51a3e77-delete_snapshot" released by "delete_snapshot" :: held 3.587s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "cinder-2b51645b-fa83-419f-9467-a375077c251a-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-2b51645b-fa83-419f-9467-a375077c251a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "cinder-quobyte-2b51645b-fa83-419f-9467-a375077c251a" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-quobyte-2b51645b-fa83-419f-9467-a375077c251a" acquired by "delete_volume" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd97757-f5e5-495f-84e5-a70fc872ec56]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2b51645b-fa83-419f-9467-a375077c251a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:11 devstack sudo[110796]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79 1G" returned: 0 in 0.923s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84aa241d-4683-427c-a56c-0e7969be9f99 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:11 devstack sudo[110805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2b51645b-fa83-419f-9467-a375077c251a
Jun 18 11:49:11 devstack sudo[110805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:11 devstack sudo[110799]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:11 devstack sudo[110807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84aa241d-4683-427c-a56c-0e7969be9f99 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.662s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:11 devstack sudo[110807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:49:11 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Deleted volume successfully.
Jun 18 11:49:11 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7ed43c57-1099-4aa9-9f47-2c715087d24c tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-8ce7828a-1a08-4ee2-ac2f-bc1ce4149441-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "cinder-1e2c4aa5-fa1a-4460-8d09-09a7877471bc-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-1e2c4aa5-fa1a-4460-8d09-09a7877471bc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "cinder-quobyte-1e2c4aa5-fa1a-4460-8d09-09a7877471bc" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:12 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-quobyte-1e2c4aa5-fa1a-4460-8d09-09a7877471bc" acquired by "delete_volume" :: waited 0.024s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:12 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a110666-2941-4c38-a4d5-687f4ba16312]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:12 devstack sudo[110810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc
Jun 18 11:49:12 devstack sudo[110810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:12 devstack sudo[110805]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2b51645b-fa83-419f-9467-a375077c251a" returned: 0 in 0.832s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:12 devstack sudo[110807]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2b51645b-fa83-419f-9467-a375077c251a {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84aa241d-4683-427c-a56c-0e7969be9f99 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79" returned: 0 in 0.745s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:12 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79 is being set with open permissions: ugo+rw
Jun 18 11:49:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:12 devstack sudo[110818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2b51645b-fa83-419f-9467-a375077c251a
Jun 18 11:49:12 devstack sudo[110818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:12 devstack sudo[110819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79
Jun 18 11:49:12 devstack sudo[110819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:12 devstack sudo[110810]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc" returned: 0 in 0.789s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:12 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:12 devstack sudo[110825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc
Jun 18 11:49:12 devstack sudo[110825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:13 devstack sudo[110819]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79" returned: 0 in 0.669s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:13 devstack sudo[110818]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-2b51645b-fa83-419f-9467-a375077c251a" returned: 0 in 0.694s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-quobyte-2b51645b-fa83-419f-9467-a375077c251a" released by "delete_volume" :: held 1.570s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:13 devstack sudo[110829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.info
Jun 18 11:49:13 devstack sudo[110829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Created reservations ['177c3b39-b6ee-4948-b7cc-06b9ea76dfe5', 'f5931f18-6bfc-4201-946d-7dcac44e0685', '4d404b47-9e1d-4d53-b07a-9a6431c2019e', '1a4b92b4-4f4c-4a7f-b371-3834cb43462c'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:13 devstack sudo[110831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:49:13 devstack sudo[110831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:13 devstack sudo[110825]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-1e2c4aa5-fa1a-4460-8d09-09a7877471bc" returned: 0 in 0.704s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-quobyte-1e2c4aa5-fa1a-4460-8d09-09a7877471bc" released by "delete_volume" :: held 1.568s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] Created reservations ['d993ac8b-1a11-4f2c-8db9-3524aa996392', '80a0df0e-cf78-4dce-a224-98ec4f649d15', '7a2c27e2-3d02-4ad0-9b09-9cf68f21487d', 'c6f3abd7-c75f-4a21-a425-a0232c80799d'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:13 devstack sudo[110834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:49:13 devstack sudo[110834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "cinder-e4d316a4-5428-4de9-ae1f-42b3e9064dc4-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:13 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-e4d316a4-5428-4de9-ae1f-42b3e9064dc4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "cinder-quobyte-e4d316a4-5428-4de9-ae1f-42b3e9064dc4" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-quobyte-e4d316a4-5428-4de9-ae1f-42b3e9064dc4" acquired by "delete_volume" :: waited 0.031s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:14 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eb3dc7-7628-47cf-9cd9-209e2eb1d91a]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e4d316a4-5428-4de9-ae1f-42b3e9064dc4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:14 devstack sudo[110829]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.info" returned: 0 in 0.752s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:14 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.info is being set with open permissions: ugo+rw
Jun 18 11:49:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:14 devstack sudo[110839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.info
Jun 18 11:49:14 devstack sudo[110839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:14 devstack sudo[110831]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.704s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:14 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:49:14 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Deleted volume successfully.
Jun 18 11:49:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-175ee788-528b-4936-84dd-4b9318e3ad1a tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-2b51645b-fa83-419f-9467-a375077c251a-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:14 devstack sudo[110838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e4d316a4-5428-4de9-ae1f-42b3e9064dc4
Jun 18 11:49:14 devstack sudo[110838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:14 devstack sudo[110834]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.819s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:14 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:49:14 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] Deleted volume successfully.
Jun 18 11:49:14 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d5fb0ec8-fd30-4344-9193-ade8d05edcc5 tempest-CreateVolumesFromSnapshotTest-949316328 None] Lock "cinder-1e2c4aa5-fa1a-4460-8d09-09a7877471bc-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:14 devstack sudo[110839]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.info" returned: 0 in 0.714s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.764s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:14 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-dcc8cbac-34c9-46b2-930f-2c8df18d8f77 tempest-SnapshotDependencyTests-573631136 None] Create snapshot completed successfully
Jun 18 11:49:14 devstack sudo[110838]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e4d316a4-5428-4de9-ae1f-42b3e9064dc4" returned: 0 in 0.849s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:14 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e4d316a4-5428-4de9-ae1f-42b3e9064dc4 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:14 devstack sudo[110847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e4d316a4-5428-4de9-ae1f-42b3e9064dc4
Jun 18 11:49:14 devstack sudo[110847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:15 devstack sudo[110847]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-e4d316a4-5428-4de9-ae1f-42b3e9064dc4" returned: 0 in 0.692s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:15 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-quobyte-e4d316a4-5428-4de9-ae1f-42b3e9064dc4" released by "delete_volume" :: held 1.596s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:15 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Created reservations ['2a98edaf-ac42-4a6e-923d-2cbbf230a0d4', '78f41acd-fd6c-4c38-a8e4-befccd5acd07', '7a3bfd7f-5703-4456-b0f8-f84e4333156d', 'ec36f0d9-718a-427b-a6b7-892ab45cebff'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:15 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:15 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:15 devstack sudo[110850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:49:15 devstack sudo[110850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Flow 'volume_create_manager' (9e301865-0328-473a-ba40-d8e28840def4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905168f0-14f3-4262-8e05-d00d291c53ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905168f0-14f3-4262-8e05-d00d291c53ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a843b63c-62f2-4c91-a8b6-fc75f5bc1da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7a1ca9f0e04c8cbdc0d620adb1003e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=322a9569-edf3-438a-a08d-6ce24c911f79,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:49:16Z,use_quota=True,user_id='7ab5398d07604bfeaa81f3f280dc1ec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5623a56-2815-421b-84fd-423b21cc6cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5623a56-2815-421b-84fd-423b21cc6cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbdce7e-4772-40cf-86f9-d8a065f68e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbdce7e-4772-40cf-86f9-d8a065f68e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a843b63c-62f2-4c91-a8b6-fc75f5bc1da6', 'volume_name': 'volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6', 'volume_size': 1, 'snapshot_id': '322a9569-edf3-438a-a08d-6ce24c911f79'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e550b2d2-73eb-4494-a330-8ceb9a98e588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e550b2d2-73eb-4494-a330-8ceb9a98e588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b1cc1c-5173-43a5-90e8-9278e7439b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:16 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Volume a843b63c-62f2-4c91-a8b6-fc75f5bc1da6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6', 'volume_size': 1, 'snapshot_id': '322a9569-edf3-438a-a08d-6ce24c911f79'}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Acquiring lock "cinder-quobyte-322a9569-edf3-438a-a08d-6ce24c911f79-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6" by "_create_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-quobyte-322a9569-edf3-438a-a08d-6ce24c911f79-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Creating volume a843b63c-62f2-4c91-a8b6-fc75f5bc1da6 from snapshot 322a9569-edf3-438a-a08d-6ce24c911f79 {{(pid=91663) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Acquiring lock "cinder-quobyte-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6" by "_copy_volume_from_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "cinder-870d118f-bd50-4d39-bb79-3a5b931ee6df-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-quobyte-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] snapshot: 322a9569-edf3-438a-a08d-6ce24c911f79, volume: a843b63c-62f2-4c91-a8b6-fc75f5bc1da6,  {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-870d118f-bd50-4d39-bb79-3a5b931ee6df-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbc5c5a-6397-4806-b834-d5d38795989b]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "cinder-quobyte-870d118f-bd50-4d39-bb79-3a5b931ee6df" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-quobyte-870d118f-bd50-4d39-bb79-3a5b931ee6df" acquired by "delete_volume" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[908db4d9-0752-4efa-9af5-dd0a1562e784]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-870d118f-bd50-4d39-bb79-3a5b931ee6df {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:16 devstack sudo[110852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79
Jun 18 11:49:16 devstack sudo[110852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:16 devstack sudo[110850]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.751s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:49:16 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Deleted volume successfully.
Jun 18 11:49:16 devstack sudo[110854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-870d118f-bd50-4d39-bb79-3a5b931ee6df
Jun 18 11:49:16 devstack sudo[110854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:16 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-f113df43-a65e-4b4d-bde4-fcebc9aac1c6 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-e4d316a4-5428-4de9-ae1f-42b3e9064dc4-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:17 devstack sudo[110852]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79" returned: 0 in 0.857s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84aa241d-4683-427c-a56c-0e7969be9f99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:49:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99 {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 18 11:49:17 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Creating direct copy from snapshot {{(pid=91663) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 18 11:49:17 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[4600da2d-9e2c-4cbc-a226-e78acb8dd2cc]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:17 devstack sudo[110854]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-870d118f-bd50-4d39-bb79-3a5b931ee6df" returned: 0 in 0.850s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:17 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-870d118f-bd50-4d39-bb79-3a5b931ee6df {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:17 devstack sudo[110865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-870d118f-bd50-4d39-bb79-3a5b931ee6df
Jun 18 11:49:17 devstack sudo[110865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:17 devstack sudo[110864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99
Jun 18 11:49:17 devstack sudo[110864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:18 devstack sudo[110865]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-870d118f-bd50-4d39-bb79-3a5b931ee6df" returned: 0 in 0.696s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-quobyte-870d118f-bd50-4d39-bb79-3a5b931ee6df" released by "delete_volume" :: held 1.601s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:18 devstack sudo[110864]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99" returned: 0 in 0.833s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG cinder.utils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Path /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6 not found in is_blk_device check {{(pid=91663) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Created reservations ['d0492581-f4aa-44fe-874f-fef9b5491187', 'ebb57549-8b6e-4e35-b71d-12ce494fea7c', 'c2c1ea55-5866-431f-a767-f99b79bf7e06', 'da3c81b2-a422-424c-9506-ea81107db850'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:18 devstack sudo[110872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6
Jun 18 11:49:18 devstack sudo[110872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:18 devstack sudo[110874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:49:18 devstack sudo[110874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "cinder-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "cinder-quobyte-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-quobyte-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121" acquired by "delete_volume" :: waited 0.041s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a98b280-d301-4d69-a197-3eed54c8bc08]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:18 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:18 devstack sudo[110879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121
Jun 18 11:49:18 devstack sudo[110879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:18 devstack sudo[110874]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:19 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.811s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:19 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:49:19 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Deleted volume successfully.
Jun 18 11:49:19 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-291ae748-547e-4ad7-b887-3a735e16eed7 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-870d118f-bd50-4d39-bb79-3a5b931ee6df-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:20 devstack sudo[110879]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121" returned: 0 in 1.967s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:20 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:20 devstack sudo[110893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121
Jun 18 11:49:20 devstack sudo[110893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:21 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:49:21 devstack sudo[110893]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Flow 'volume_create_manager' (d887dc33-4abc-49aa-a476-e7007d683791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:49:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ee99a3-07c4-43df-b810-84166e22720a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:21 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121" returned: 0 in 1.083s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ee99a3-07c4-43df-b810-84166e22720a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dc991b-6687-487d-ac18-bb3f60dfe322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fac3d90220c4f819377d7cb3eaf0ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:49:22Z,use_quota=True,user_id='0b39f3e69bd74a03af25970f74cffdbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29b2e3a-ee40-4550-856b-d1f7717d29b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29b2e3a-ee40-4550-856b-d1f7717d29b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:21 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d094b6-007e-4b71-a328-d5fcf4658d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:21 devstack cinder-volume[91663]: DEBUG cinder.image.glance [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Creating Keystone auth plugin from conf {{(pid=91663) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 18 11:49:21 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-quobyte-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121" released by "delete_volume" :: held 3.211s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:22 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Created reservations ['70a31eb7-7d71-4bf7-89db-b64a8c44057d', 'f7adf1e9-187b-4366-aad1-ab84d4d9b4c9', 'c3eba16e-a46f-47c4-af01-591a19b183d9', '9cdfb307-ea44-4eca-a643-741bc241e979'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:22 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:22 devstack sudo[110897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:49:22 devstack sudo[110897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:22 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d094b6-007e-4b71-a328-d5fcf4658d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '95dc991b-6687-487d-ac18-bb3f60dfe322', 'volume_name': 'volume-95dc991b-6687-487d-ac18-bb3f60dfe322', 'volume_size': 1, 'image_id': '88459588-d65a-4540-baa5-5843e3211fcb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88459588-d65a-4540-baa5-5843e3211fcb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ba41bdd3c1983933fa7da6ce6dc9909', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1fac3d90220c4f819377d7cb3eaf0ba0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc30241837b76cf07a1b2e1cc9983d45f4a616a76c649181344fe5d0b5eb38c28bd6a5f7fe1c1841963a81e0073c0c628f2b1063e7e8db05230a307631fa7ba1', 'id': '88459588-d65a-4540-baa5-5843e3211fcb', 'created_at': datetime.datetime(2026, 6, 18, 9, 49, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 49, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88459588-d65a-4540-baa5-5843e3211fcb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ffb164950>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:22 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e69a782-b8fb-4058-bf18-f6abd86d5db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:22 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e69a782-b8fb-4058-bf18-f6abd86d5db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:22 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c70dbb58-dafa-4d21-ab30-a3a5d84ffd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:22 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Volume 95dc991b-6687-487d-ac18-bb3f60dfe322: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-95dc991b-6687-487d-ac18-bb3f60dfe322', 'volume_size': 1, 'image_id': '88459588-d65a-4540-baa5-5843e3211fcb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88459588-d65a-4540-baa5-5843e3211fcb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ba41bdd3c1983933fa7da6ce6dc9909', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1fac3d90220c4f819377d7cb3eaf0ba0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc30241837b76cf07a1b2e1cc9983d45f4a616a76c649181344fe5d0b5eb38c28bd6a5f7fe1c1841963a81e0073c0c628f2b1063e7e8db05230a307631fa7ba1', 'id': '88459588-d65a-4540-baa5-5843e3211fcb', 'created_at': datetime.datetime(2026, 6, 18, 9, 49, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 49, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88459588-d65a-4540-baa5-5843e3211fcb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ffb164950>}
Jun 18 11:49:22 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Trying to clone 95dc991b-6687-487d-ac18-bb3f60dfe322 from image 88459588-d65a-4540-baa5-5843e3211fcb at location (None, [{'url': 'file:///opt/stack/data/glance/images/88459588-d65a-4540-baa5-5843e3211fcb', 'metadata': {}}]). {{(pid=91663) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 18 11:49:22 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 18 11:49:22 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Image download 0.00 MB at 0.00 MB/s
Jun 18 11:49:22 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[645ed843-2285-4e9a-8fb0-6ba3b5a39836]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:22 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:23 devstack sudo[110899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD
Jun 18 11:49:23 devstack sudo[110899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:23 devstack sudo[110897]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:23 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 1.218s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:23 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:49:23 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Deleted volume successfully.
Jun 18 11:49:23 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-7d4f51be-7961-441c-8c49-0069894f5b69 tempest-CreateVolumesFromSourceVolumeTest-135779812 None] Lock "cinder-3d841d1f-484d-47bc-a8a5-bdbdfa0cc121-delete_volume" released by "delete_volume" :: held 4.907s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:24 devstack sudo[110872]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6" returned: 0 in 5.935s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:24 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc44156-1f66-46dd-a9e2-bc42f9008e30]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:24 devstack sudo[110902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99
Jun 18 11:49:24 devstack sudo[110902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:24 devstack sudo[110899]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD" returned: 0 in 1.218s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:24 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:24 devstack sudo[110906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD
Jun 18 11:49:24 devstack sudo[110906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:25 devstack sudo[110906]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD" returned: 1 in 0.845s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Temporary image 88459588-d65a-4540-baa5-5843e3211fcb is fetched for user 0b39f3e69bd74a03af25970f74cffdbd. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 18 11:49:25 devstack sudo[110902]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99" returned: 0 in 1.063s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6 {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:49:25 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Converted 1024.00 MB image at 172.51 MB/s
Jun 18 11:49:25 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6 is being set with open permissions: ugo+rw
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:25 devstack sudo[110914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6
Jun 18 11:49:25 devstack sudo[110914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac0ab35-b451-48e3-8022-615462a7f238]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:25 devstack sudo[110916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD
Jun 18 11:49:25 devstack sudo[110916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:25 devstack sudo[110918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:49:25 devstack sudo[110918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:25 devstack sudo[110914]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6" returned: 0 in 0.692s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-quobyte-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6" released by "_copy_volume_from_snapshot" :: held 9.510s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-quobyte-322a9569-edf3-438a-a08d-6ce24c911f79-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6" released by "_create_volume_from_snapshot" :: held 9.564s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.593s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b1cc1c-5173-43a5-90e8-9278e7439b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6', 'volume_size': 1, 'snapshot_id': '322a9569-edf3-438a-a08d-6ce24c911f79'}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4daaea6f-9fe3-47f0-9049-349fc6d71ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:25 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Volume volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6 (a843b63c-62f2-4c91-a8b6-fc75f5bc1da6): created successfully
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4daaea6f-9fe3-47f0-9049-349fc6d71ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Flow 'volume_create_manager' (9e301865-0328-473a-ba40-d8e28840def4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:49:25 devstack sudo[110916]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:25 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:25 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-20b985fc-a686-431e-83ec-d17b092ab468 tempest-SnapshotDependencyTests-573631136 None] Created volume successfully.
Jun 18 11:49:26 devstack sudo[110923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD
Jun 18 11:49:26 devstack sudo[110923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:26 devstack sudo[110918]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.654s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG oslo_service.periodic_task [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] Running periodic task VolumeManager._thread_info {{(pid=91663) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread count: 28 {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-ecef7688-d747-4f6f-ac6a-745092477a93 None None] thread info: [<_MainThread(MainThread, started 127680827416704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127680719788160)>, <Thread(Thread-3 (stat_writer), started daemon 127680716566464)>, <Thread(Rabbit-heartbeat, started daemon 127680715511744)>, <Thread(Thread-5 (_runner), started daemon 127680715679872)>, <Thread(Thread-7 (_runner), started daemon 127680715691840)>, <Thread(fd_logger, started daemon 127680711610816)>, <Thread(privsep_reader, started daemon 127680712377408)>, <Thread(tpool_thread_0, started daemon 127680705238720)>, <Thread(tpool_thread_1, started daemon 127680696846016)>, <Thread(tpool_thread_2, started daemon 127680688453312)>, <Thread(tpool_thread_3, started daemon 127680680060608)>, <Thread(tpool_thread_4, started daemon 127680671667904)>, <Thread(tpool_thread_5, started daemon 127680663275200)>, <Thread(tpool_thread_6, started daemon 127680654882496)>, <Thread(tpool_thread_7, started daemon 127680646489792)>, <Thread(tpool_thread_8, started daemon 127680638097088)>, <Thread(tpool_thread_9, started daemon 127680629704384)>, <Thread(tpool_thread_10, started daemon 127680621311680)>, <Thread(tpool_thread_11, started daemon 127680612902592)>, <Thread(tpool_thread_12, started daemon 127680604493504)>, <Thread(tpool_thread_13, started daemon 127680596084416)>, <Thread(tpool_thread_14, started daemon 127680587675328)>, <Thread(tpool_thread_15, started daemon 127680579266240)>, <Thread(tpool_thread_16, started daemon 127680570857152)>, <Thread(tpool_thread_17, started daemon 127680562448064)>, <Thread(tpool_thread_18, started daemon 127680554038976)>, <Thread(tpool_thread_19, started daemon 127680545629888)>] {{(pid=91663) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] Acquiring lock "cinder-322a9569-edf3-438a-a08d-6ce24c911f79-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-322a9569-edf3-438a-a08d-6ce24c911f79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] Acquiring lock "cinder-quobyte-84aa241d-4683-427c-a56c-0e7969be9f99" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-quobyte-84aa241d-4683-427c-a56c-0e7969be9f99" acquired by "delete_snapshot" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] Acquiring lock "cinder-quobyte-322a9569-edf3-438a-a08d-6ce24c911f79" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-quobyte-322a9569-edf3-438a-a08d-6ce24c911f79" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] Deleting offline snapshot 322a9569-edf3-438a-a08d-6ce24c911f79 of volume 84aa241d-4683-427c-a56c-0e7969be9f99 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] snapshot_file for this snap is: volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd802a1-dfd7-404c-8253-bcaf6de586f1]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:26 devstack sudo[110926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79
Jun 18 11:49:26 devstack sudo[110926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:26 devstack sudo[110923]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD" returned: 1 in 0.725s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dc991b-6687-487d-ac18-bb3f60dfe322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fac3d90220c4f819377d7cb3eaf0ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:49:22Z,use_quota=True,user_id='0b39f3e69bd74a03af25970f74cffdbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Creating volume 95dc991b-6687-487d-ac18-bb3f60dfe322 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:49:26 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:49:26 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:26 devstack sudo[110931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322 1073741824
Jun 18 11:49:26 devstack sudo[110931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:27 devstack sudo[110926]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79" returned: 0 in 0.765s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:27 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84aa241d-4683-427c-a56c-0e7969be9f99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:49:27 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[a710fa5f-0048-46cf-be11-161d092dc1c4]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:27 devstack sudo[110973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99
Jun 18 11:49:27 devstack sudo[110973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:27 devstack sudo[110931]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322 1073741824" returned: 0 in 0.852s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:27 devstack sudo[110978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322
Jun 18 11:49:27 devstack sudo[110978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:27 devstack sudo[110973]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99" returned: 0 in 0.787s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:27 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:27 devstack sudo[110983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79
Jun 18 11:49:27 devstack sudo[110983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:28 devstack sudo[110978]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322" returned: 0 in 0.656s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:28 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:49:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:28 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Attempting download of 88459588-d65a-4540-baa5-5843e3211fcb ((None, [{'url': 'file:///opt/stack/data/glance/images/88459588-d65a-4540-baa5-5843e3211fcb', 'metadata': {}}])) to volume 95dc991b-6687-487d-ac18-bb3f60dfe322. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 18 11:49:28 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41d6fa3-4e7e-4f9e-af20-44434bb29d85]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88459588-d65a-4540-baa5-5843e3211fcb_30p29sdi {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:28 devstack sudo[110986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88459588-d65a-4540-baa5-5843e3211fcb_30p29sdi
Jun 18 11:49:28 devstack sudo[110986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:28 devstack sudo[110983]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79" returned: 0 in 0.734s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:28 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:28 devstack sudo[110991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79
Jun 18 11:49:28 devstack sudo[110991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:29 devstack sudo[110986]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88459588-d65a-4540-baa5-5843e3211fcb_30p29sdi" returned: 0 in 0.758s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88459588-d65a-4540-baa5-5843e3211fcb_30p29sdi {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:29 devstack sudo[110995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88459588-d65a-4540-baa5-5843e3211fcb_30p29sdi
Jun 18 11:49:29 devstack sudo[110995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:29 devstack sudo[110991]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99.322a9569-edf3-438a-a08d-6ce24c911f79" returned: 0 in 0.652s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:29 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-quobyte-322a9569-edf3-438a-a08d-6ce24c911f79" released by "_delete_snapshot" :: held 3.037s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:29 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-quobyte-84aa241d-4683-427c-a56c-0e7969be9f99" released by "delete_snapshot" :: held 3.061s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:29 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] Created reservations ['e84219b7-738f-43d1-9abf-eb691e791cfa', '76a2ab8e-3c8d-472a-bd48-6ca5537d672c', 'bd4bde65-2365-4001-a91c-883845f2a14d', '97cd2fd5-daf6-45f9-9b21-268c46779c6f'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:29 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] Delete snapshot completed successfully.
Jun 18 11:49:29 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-405fa026-db1d-482d-9a8b-2749305f40f5 tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-322a9569-edf3-438a-a08d-6ce24c911f79-delete_snapshot" released by "delete_snapshot" :: held 3.198s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:29 devstack sudo[110995]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88459588-d65a-4540-baa5-5843e3211fcb_30p29sdi" returned: 1 in 0.744s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88459588-d65a-4540-baa5-5843e3211fcb_30p29sdi' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:49:29 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[869364af-e017-466d-9aec-8e322debc098]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:29 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:29 devstack sudo[111000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD
Jun 18 11:49:29 devstack sudo[111000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] Acquiring lock "cinder-84aa241d-4683-427c-a56c-0e7969be9f99-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-84aa241d-4683-427c-a56c-0e7969be9f99-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] Acquiring lock "cinder-quobyte-84aa241d-4683-427c-a56c-0e7969be9f99" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:30 devstack sudo[111000]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD" returned: 0 in 0.737s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:30 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-quobyte-84aa241d-4683-427c-a56c-0e7969be9f99" acquired by "delete_volume" :: waited 0.019s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:30 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[e986f04e-9e00-4374-9b95-0b570e8610e7]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:30 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:30 devstack sudo[111005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD
Jun 18 11:49:30 devstack sudo[111005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:30 devstack sudo[111006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99
Jun 18 11:49:30 devstack sudo[111006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:31 devstack sudo[111005]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD" returned: 1 in 0.749s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:49:31 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] 88459588-d65a-4540-baa5-5843e3211fcb was raw, converting to raw {{(pid=91663) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 18 11:49:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:31 devstack sudo[111006]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99" returned: 0 in 0.758s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:31 devstack sudo[111015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322
Jun 18 11:49:31 devstack sudo[111015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:31 devstack sudo[111016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99
Jun 18 11:49:31 devstack sudo[111016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:31 devstack sudo[111016]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:31 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-84aa241d-4683-427c-a56c-0e7969be9f99" returned: 0 in 0.687s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:32 devstack sudo[111015]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-quobyte-84aa241d-4683-427c-a56c-0e7969be9f99" released by "delete_volume" :: held 1.506s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322" returned: 0 in 0.726s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_88459588-d65a-4540-baa5-5843e3211fcb_g0o9zmkkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322 {{(pid=91663) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 18 11:49:32 devstack cinder-volume[91663]: INFO cinder.image.image_utils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Converted 0.00 MB image at 0.00 MB/s
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:32 devstack sudo[111023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322 1G
Jun 18 11:49:32 devstack sudo[111023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] Created reservations ['363dde95-c746-4584-b025-65e6dd33b039', 'c73ef5c6-ba4c-4943-94ea-c090bfa578f4', 'ad30c5ba-95f0-4b0e-96cd-dc7889783686', '2381852e-0492-43cc-97d3-392f67f53722'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:32 devstack sudo[111025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:49:32 devstack sudo[111025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] Acquiring lock "cinder-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] Acquiring lock "cinder-quobyte-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-quobyte-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6" acquired by "delete_volume" :: waited 0.029s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:32 devstack sudo[111023]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322 1G" returned: 0 in 0.754s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31b2f81-961c-4165-833a-586e760120c1]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f5ab7c-bd26-44e1-8506-d0095ca2bbc3]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:32 devstack sudo[111025]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.681s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:49:32 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] Deleted volume successfully.
Jun 18 11:49:32 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-d4b35bf7-1b9a-461d-b732-b76b6ccd325e tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-84aa241d-4683-427c-a56c-0e7969be9f99-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:32 devstack sudo[111031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6
Jun 18 11:49:32 devstack sudo[111031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:32 devstack sudo[111032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322
Jun 18 11:49:32 devstack sudo[111032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:33 devstack sudo[111031]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6" returned: 0 in 0.774s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:33 devstack sudo[111032]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322" returned: 0 in 0.758s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:33 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:33 devstack sudo[111040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6
Jun 18 11:49:33 devstack sudo[111040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:33 devstack sudo[111041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322
Jun 18 11:49:33 devstack sudo[111041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:34 devstack sudo[111040]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6" returned: 0 in 0.647s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-quobyte-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6" released by "delete_volume" :: held 1.471s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] Created reservations ['918b0af3-8ac5-4dd7-9d4c-9c9bc0c23a31', '5ca4802f-5865-44fc-8070-a1351ac3898f', '2e8c0317-180a-41ce-b4a0-b675bff44072', '9886fb4e-677b-43e8-9710-083dc552205f'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:34 devstack sudo[111041]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322" returned: 1 in 0.779s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Downloaded image 88459588-d65a-4540-baa5-5843e3211fcb ((None, [{'url': 'file:///opt/stack/data/glance/images/88459588-d65a-4540-baa5-5843e3211fcb', 'metadata': {}}])) to volume 95dc991b-6687-487d-ac18-bb3f60dfe322 successfully. {{(pid=91663) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG cinder.image.image_utils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Temporary image 88459588-d65a-4540-baa5-5843e3211fcb for user 0b39f3e69bd74a03af25970f74cffdbd is deleted. {{(pid=91663) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG cinder.volume.volume_utils [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Marking volume 95dc991b-6687-487d-ac18-bb3f60dfe322 as bootable. {{(pid=91663) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 18 11:49:34 devstack sudo[111048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:49:34 devstack sudo[111048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Copying metadata from image 88459588-d65a-4540-baa5-5843e3211fcb to 95dc991b-6687-487d-ac18-bb3f60dfe322. {{(pid=91663) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Creating volume glance metadata for volume 95dc991b-6687-487d-ac18-bb3f60dfe322 backed by image 88459588-d65a-4540-baa5-5843e3211fcb with: {'image_id': '88459588-d65a-4540-baa5-5843e3211fcb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2ba41bdd3c1983933fa7da6ce6dc9909', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=91663) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c70dbb58-dafa-4d21-ab30-a3a5d84ffd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95dc991b-6687-487d-ac18-bb3f60dfe322', 'volume_size': 1, 'image_id': '88459588-d65a-4540-baa5-5843e3211fcb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88459588-d65a-4540-baa5-5843e3211fcb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ba41bdd3c1983933fa7da6ce6dc9909', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1fac3d90220c4f819377d7cb3eaf0ba0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc30241837b76cf07a1b2e1cc9983d45f4a616a76c649181344fe5d0b5eb38c28bd6a5f7fe1c1841963a81e0073c0c628f2b1063e7e8db05230a307631fa7ba1', 'id': '88459588-d65a-4540-baa5-5843e3211fcb', 'created_at': datetime.datetime(2026, 6, 18, 9, 49, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 18, 9, 49, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88459588-d65a-4540-baa5-5843e3211fcb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x741ffb164950>}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132f132d-b204-40ab-bc71-b77abd3ad6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:34 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Volume volume-95dc991b-6687-487d-ac18-bb3f60dfe322 (95dc991b-6687-487d-ac18-bb3f60dfe322): created successfully
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132f132d-b204-40ab-bc71-b77abd3ad6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Flow 'volume_create_manager' (d887dc33-4abc-49aa-a476-e7007d683791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:49:34 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d82afc74-23d6-4139-b954-f3bfe1dc55cc tempest-VolumeImageDependencyTests-731882069 None] Created volume successfully.
Jun 18 11:49:34 devstack sudo[111048]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.648s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:34 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:49:35 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] Deleted volume successfully.
Jun 18 11:49:35 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-38a0326a-a903-47dd-a544-d0d153c1a1b7 tempest-SnapshotDependencyTests-573631136 None] Lock "cinder-a843b63c-62f2-4c91-a8b6-fc75f5bc1da6-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:35 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Acquiring lock "cinder-95dc991b-6687-487d-ac18-bb3f60dfe322-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:35 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Lock "cinder-95dc991b-6687-487d-ac18-bb3f60dfe322-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:35 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Acquiring lock "cinder-quobyte-95dc991b-6687-487d-ac18-bb3f60dfe322" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:35 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Lock "cinder-quobyte-95dc991b-6687-487d-ac18-bb3f60dfe322" acquired by "delete_volume" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:35 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d2d690-0e29-455c-801b-8a4e62c87ae4]: (4, 'raw') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:35 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:35 devstack sudo[111051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322
Jun 18 11:49:35 devstack sudo[111051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:36 devstack sudo[111051]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322" returned: 0 in 0.826s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:36 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:36 devstack sudo[111057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322
Jun 18 11:49:36 devstack sudo[111057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:37 devstack sudo[111057]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322" returned: 1 in 0.797s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322' failed. Not Retrying. {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 18 11:49:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:37 devstack sudo[111062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322
Jun 18 11:49:37 devstack sudo[111062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:37 devstack sudo[111062]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:37 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-95dc991b-6687-487d-ac18-bb3f60dfe322" returned: 0 in 0.715s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:37 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Lock "cinder-quobyte-95dc991b-6687-487d-ac18-bb3f60dfe322" released by "delete_volume" :: held 2.411s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:37 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Created reservations ['8ed7ca82-2d59-4cc0-b922-13a4735dd8ba', '8a344c4f-86a4-452d-9d95-0e395216c2a0', 'ef606c5b-982b-4cfc-af5c-c918b12f5a8c', '53472665-87c7-4f32-9b3c-ee73bd291156'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:38 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:38 devstack sudo[111065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:49:38 devstack sudo[111065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:38 devstack sudo[111065]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:38 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.680s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:38 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:49:38 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Deleted volume successfully.
Jun 18 11:49:38 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-8bc3f6a1-aa6e-4f32-a7cb-8aa2d0ea873c tempest-VolumeImageDependencyTests-731882069 None] Lock "cinder-95dc991b-6687-487d-ac18-bb3f60dfe322-delete_volume" released by "delete_volume" :: held 3.308s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Flow 'volume_create_manager' (7ca9a2b5-4d27-4e70-8926-d98c05fba841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589215d8-fa12-4ba0-a8f2-67ec2067dbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589215d8-fa12-4ba0-a8f2-67ec2067dbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207f0bf8-3654-4cfe-a9f4-de7303d22a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5727fdbc83847a1bec0c6c99f7c217b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:49:42Z,use_quota=True,user_id='1215341b6b0f40f38c5addb609417cb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72008298-7f3b-4710-a1ec-a58e69efda02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72008298-7f3b-4710-a1ec-a58e69efda02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9be7ad-e2fb-4d6b-b6da-40019ef3e6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9be7ad-e2fb-4d6b-b6da-40019ef3e6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '207f0bf8-3654-4cfe-a9f4-de7303d22a41', 'volume_name': 'volume-207f0bf8-3654-4cfe-a9f4-de7303d22a41', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90af4b93-624f-4a21-9780-842546c99daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90af4b93-624f-4a21-9780-842546c99daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8618c2-eac1-41a4-84a2-7fbbde051ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:42 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Volume 207f0bf8-3654-4cfe-a9f4-de7303d22a41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-207f0bf8-3654-4cfe-a9f4-de7303d22a41', 'volume_size': 1}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207f0bf8-3654-4cfe-a9f4-de7303d22a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5727fdbc83847a1bec0c6c99f7c217b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:49:42Z,use_quota=True,user_id='1215341b6b0f40f38c5addb609417cb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Creating volume 207f0bf8-3654-4cfe-a9f4-de7303d22a41 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:49:42 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:49:42 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-207f0bf8-3654-4cfe-a9f4-de7303d22a41 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:42 devstack sudo[111072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-207f0bf8-3654-4cfe-a9f4-de7303d22a41 1073741824
Jun 18 11:49:42 devstack sudo[111072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:43 devstack sudo[111072]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-207f0bf8-3654-4cfe-a9f4-de7303d22a41 1073741824" returned: 0 in 0.903s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-207f0bf8-3654-4cfe-a9f4-de7303d22a41 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:43 devstack sudo[111078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-207f0bf8-3654-4cfe-a9f4-de7303d22a41
Jun 18 11:49:43 devstack sudo[111078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:43 devstack sudo[111078]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-207f0bf8-3654-4cfe-a9f4-de7303d22a41" returned: 0 in 0.650s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:43 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:49:43 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8618c2-eac1-41a4-84a2-7fbbde051ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-207f0bf8-3654-4cfe-a9f4-de7303d22a41', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83650dcd-170a-4187-adaa-e768e7e79eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:43 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Volume volume-207f0bf8-3654-4cfe-a9f4-de7303d22a41 (207f0bf8-3654-4cfe-a9f4-de7303d22a41): created successfully
Jun 18 11:49:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83650dcd-170a-4187-adaa-e768e7e79eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:43 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Flow 'volume_create_manager' (7ca9a2b5-4d27-4e70-8926-d98c05fba841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:49:43 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-e1a9707a-2044-46c8-bd24-3c7da916a0e7 tempest-CinderUnicodeTest-281903789 None] Created volume successfully.
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG cinder.volume.flows.manager.create_volume [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91663) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Flow 'volume_create_manager' (7307efc5-437f-4c26-8e83-3b57d5691926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b41504f5-61d9-4a0f-ad4a-9afc6e50cf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b41504f5-61d9-4a0f-ad4a-9afc6e50cf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:49:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-332627243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebbb2d9-c009-4b41-8e95-b10ba43d01f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5727fdbc83847a1bec0c6c99f7c217b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:49:45Z,use_quota=True,user_id='1215341b6b0f40f38c5addb609417cb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294e31eb-9cb5-4d22-9aa7-d185a2ee4616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294e31eb-9cb5-4d22-9aa7-d185a2ee4616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5063c28-9e93-42ec-8410-7415d65869b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5063c28-9e93-42ec-8410-7415d65869b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ebbb2d9-c009-4b41-8e95-b10ba43d01f7', 'volume_name': 'volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9fef5f-2c5f-460a-b4c5-1901f2345c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9fef5f-2c5f-460a-b4c5-1901f2345c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456c0984-92fc-4f62-a43f-8a21c51f6fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:44 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Volume 8ebbb2d9-c009-4b41-8e95-b10ba43d01f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7', 'volume_size': 1}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x741ffbc9d4f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-18T09:49:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-332627243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebbb2d9-c009-4b41-8e95-b10ba43d01f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5727fdbc83847a1bec0c6c99f7c217b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-18T09:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-18T09:49:45Z,use_quota=True,user_id='1215341b6b0f40f38c5addb609417cb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc522193-e474-43f5-bca0-00a759a2ebb6),volume_type_id=fc522193-e474-43f5-bca0-00a759a2ebb6)}" {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Creating volume 8ebbb2d9-c009-4b41-8e95-b10ba43d01f7 {{(pid=91663) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Selected osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e as target Quobyte volume. {{(pid=91663) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 18 11:49:44 devstack cinder-volume[91663]: INFO cinder.volume.drivers.remotefs [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] casted to osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e
Jun 18 11:49:44 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7 1073741824 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:44 devstack sudo[111081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7 1073741824
Jun 18 11:49:44 devstack sudo[111081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:45 devstack sudo[111081]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7 1073741824" returned: 0 in 0.811s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:45 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:45 devstack sudo[111087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7
Jun 18 11:49:45 devstack sudo[111087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:46 devstack sudo[111087]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7" returned: 0 in 0.645s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'} {{(pid=91663) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 18 11:49:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456c0984-92fc-4f62-a43f-8a21c51f6fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7', 'volume_size': 1}' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80413b19-74fd-46b0-845c-84aeb5a498cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 18 11:49:46 devstack cinder-volume[91663]: INFO cinder.volume.flows.manager.create_volume [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Volume volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7 (8ebbb2d9-c009-4b41-8e95-b10ba43d01f7): created successfully
Jun 18 11:49:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80413b19-74fd-46b0-845c-84aeb5a498cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91663) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 18 11:49:46 devstack cinder-volume[91663]: DEBUG cinder.volume.manager [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Flow 'volume_create_manager' (7307efc5-437f-4c26-8e83-3b57d5691926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91663) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 18 11:49:46 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-c94ae4f7-177e-4a31-b78a-ea394a56284f tempest-CinderUnicodeTest-281903789 None] Created volume successfully.
Jun 18 11:49:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:46 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] Creating offline snapshot ad9762f8-8963-4a5b-b1c9-7bbbfe330863 of volume 8ebbb2d9-c009-4b41-8e95-b10ba43d01f7 {{(pid=91663) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 18 11:49:46 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[5008a8bd-a6a3-46a1-a2af-e38f0c167bf6]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:46 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:47 devstack sudo[111090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7
Jun 18 11:49:47 devstack sudo[111090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:47 devstack sudo[111090]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7" returned: 0 in 0.754s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:47 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863 1G {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:47 devstack sudo[111095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863 1G
Jun 18 11:49:47 devstack sudo[111095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:48 devstack sudo[111095]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863 1G" returned: 0 in 0.779s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:48 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:48 devstack sudo[111100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863
Jun 18 11:49:48 devstack sudo[111100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:49 devstack sudo[111100]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7 -F qcow2 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863" returned: 0 in 0.696s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:49 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863 is being set with open permissions: ugo+rw
Jun 18 11:49:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:49 devstack sudo[111105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863
Jun 18 11:49:49 devstack sudo[111105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:49 devstack sudo[111105]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863" returned: 0 in 0.627s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:49 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:49 devstack sudo[111108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.info
Jun 18 11:49:49 devstack sudo[111108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:50 devstack sudo[111108]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.info" returned: 0 in 0.645s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:50 devstack cinder-volume[91663]: WARNING cinder.volume.drivers.remotefs [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.info is being set with open permissions: ugo+rw
Jun 18 11:49:50 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.info {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:50 devstack sudo[111112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.info
Jun 18 11:49:50 devstack sudo[111112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:51 devstack sudo[111112]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.info" returned: 0 in 0.643s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:51 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.228s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:51 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-d9b098e5-91b5-4d89-b9c1-3d138bb7f688 tempest-CinderUnicodeTest-281903789 None] Create snapshot completed successfully
Jun 18 11:49:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] Acquiring lock "cinder-ad9762f8-8963-4a5b-b1c9-7bbbfe330863-delete_snapshot" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] Lock "cinder-ad9762f8-8963-4a5b-b1c9-7bbbfe330863-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] Acquiring lock "cinder-quobyte-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7" by "delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] Lock "cinder-quobyte-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] Acquiring lock "cinder-quobyte-ad9762f8-8963-4a5b-b1c9-7bbbfe330863" by "_delete_snapshot" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:52 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] Lock "cinder-quobyte-ad9762f8-8963-4a5b-b1c9-7bbbfe330863" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] Deleting offline snapshot ad9762f8-8963-4a5b-b1c9-7bbbfe330863 of volume 8ebbb2d9-c009-4b41-8e95-b10ba43d01f7 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 18 11:49:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] snapshot_file for this snap is: volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863 {{(pid=91663) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 18 11:49:52 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e573f7-62ce-44e1-9bec-9c0f0ccc2c76]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:52 devstack sudo[111116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863
Jun 18 11:49:52 devstack sudo[111116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:52 devstack sudo[111116]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863" returned: 0 in 0.744s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:52 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.remotefs [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91663) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 18 11:49:52 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e25950-bdf7-4e49-90e6-366b0d36c4ca]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:52 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:53 devstack sudo[111121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7
Jun 18 11:49:53 devstack sudo[111121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:53 devstack sudo[111121]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7" returned: 0 in 0.751s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:53 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:53 devstack sudo[111126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863
Jun 18 11:49:53 devstack sudo[111126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:54 devstack sudo[111126]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863" returned: 0 in 0.726s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:54 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:54 devstack sudo[111131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863
Jun 18 11:49:54 devstack sudo[111131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:55 devstack sudo[111131]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7.ad9762f8-8963-4a5b-b1c9-7bbbfe330863" returned: 0 in 0.632s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] Lock "cinder-quobyte-ad9762f8-8963-4a5b-b1c9-7bbbfe330863" released by "_delete_snapshot" :: held 2.951s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] Lock "cinder-quobyte-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7" released by "delete_snapshot" :: held 2.975s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:55 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] Created reservations ['e344c1a0-e044-4b9d-a229-8c01fc912889', '8301d1fb-dfb6-4699-9fd8-ba97de61abb8', '21fa6cd1-f2ca-4cd2-be44-3c2fbcc23cf9', '2d237e04-80cf-4f45-9f40-74dce312ebb2'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:55 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] Delete snapshot completed successfully.
Jun 18 11:49:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-228e41d0-c3b6-456b-aba0-10131ec7c024 tempest-CinderUnicodeTest-281903789 None] Lock "cinder-ad9762f8-8963-4a5b-b1c9-7bbbfe330863-delete_snapshot" released by "delete_snapshot" :: held 3.100s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] Acquiring lock "cinder-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] Lock "cinder-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] Acquiring lock "cinder-quobyte-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:55 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] Lock "cinder-quobyte-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7" acquired by "delete_volume" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:55 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3605290-8ee6-4906-ae1e-4bdab62b88d4]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:55 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:55 devstack sudo[111134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7
Jun 18 11:49:55 devstack sudo[111134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:56 devstack sudo[111134]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7" returned: 0 in 0.730s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:56 devstack sudo[111139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7
Jun 18 11:49:56 devstack sudo[111139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:56 devstack sudo[111139]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7" returned: 0 in 0.656s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:56 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] Lock "cinder-quobyte-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7" released by "delete_volume" :: held 1.440s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:56 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] Created reservations ['17b91d22-c1c9-4121-a9a6-1757a01d1fff', '49c788bd-7f6a-4f3a-a03a-d1e48d62978e', 'd39e8440-9051-4b9f-bb4c-5388b25a5668', 'cdc91899-dfba-49fa-9477-16896ad9d180'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:56 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:56 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:56 devstack sudo[111142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:49:56 devstack sudo[111142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] Acquiring lock "cinder-207f0bf8-3654-4cfe-a9f4-de7303d22a41-delete_volume" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] Lock "cinder-207f0bf8-3654-4cfe-a9f4-de7303d22a41-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:57 devstack sudo[111142]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.646s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:57 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:49:57 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] Deleted volume successfully.
Jun 18 11:49:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] Acquiring lock "cinder-quobyte-207f0bf8-3654-4cfe-a9f4-de7303d22a41" by "delete_volume" {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 18 11:49:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-30aad6d5-d77c-4338-a0b5-5aeaa40de2e3 tempest-CinderUnicodeTest-281903789 None] Lock "cinder-8ebbb2d9-c009-4b41-8e95-b10ba43d01f7-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:57 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] Lock "cinder-quobyte-207f0bf8-3654-4cfe-a9f4-de7303d22a41" acquired by "delete_volume" :: waited 0.014s {{(pid=91663) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 18 11:49:57 devstack cinder-volume[91663]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac746d8-f27a-4eff-bd16-e2b79311b45a]: (4, 'qcow2') {{(pid=93026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 18 11:49:57 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-207f0bf8-3654-4cfe-a9f4-de7303d22a41 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:57 devstack sudo[111146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-207f0bf8-3654-4cfe-a9f4-de7303d22a41
Jun 18 11:49:57 devstack sudo[111146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:58 devstack sudo[111146]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-207f0bf8-3654-4cfe-a9f4-de7303d22a41" returned: 0 in 0.757s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:58 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-207f0bf8-3654-4cfe-a9f4-de7303d22a41 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:58 devstack sudo[111151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-207f0bf8-3654-4cfe-a9f4-de7303d22a41
Jun 18 11:49:58 devstack sudo[111151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:59 devstack sudo[111151]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637/volume-207f0bf8-3654-4cfe-a9f4-de7303d22a41" returned: 0 in 0.641s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] Lock "cinder-quobyte-207f0bf8-3654-4cfe-a9f4-de7303d22a41" released by "delete_volume" :: held 1.434s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:49:59 devstack cinder-volume[91663]: DEBUG cinder.quota [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] Created reservations ['206f0bc8-83a4-4e89-9bbb-d4795732b28c', '8e0efcf6-12dc-4ce9-8419-bb5560e538cc', '792be93d-04a1-4a39-9476-69e88cdc3eb9', '9f2855b9-de05-4876-9d3e-f3d142529ac1'] {{(pid=91663) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 18 11:49:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 18 11:49:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 18 11:49:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e': None} {{(pid=91663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 18 11:49:59 devstack cinder-volume[91663]: DEBUG cinder.volume.drivers.quobyte [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2491048a-0e63-4fca-bcec-dda04eb9f78e'] {{(pid=91663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 18 11:49:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.lockutils [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 18 11:49:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637 {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 18 11:49:59 devstack sudo[111154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637
Jun 18 11:49:59 devstack sudo[111154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 18 11:49:59 devstack sudo[111154]: pam_unix(sudo:session): session closed for user root
Jun 18 11:49:59 devstack cinder-volume[91663]: DEBUG oslo_concurrency.processutils [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd7a4a160b995801b43bfff3f5a5d637" returned: 0 in 0.648s {{(pid=91663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 18 11:49:59 devstack cinder-volume[91663]: DEBUG cinder.manager [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] Notifying Schedulers of capabilities ... {{(pid=91663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 18 11:49:59 devstack cinder-volume[91663]: INFO cinder.volume.manager [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] Deleted volume successfully.
Jun 18 11:49:59 devstack cinder-volume[91663]: DEBUG cinder.coordination [None req-417c85a5-74d6-4708-abbb-04fed07672c3 tempest-CinderUnicodeTest-281903789 None] Lock "cinder-207f0bf8-3654-4cfe-a9f4-de7303d22a41-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=91663) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 18 11:50:09 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:SELECT=99,cinder:INSERT=39,cinder:UPDATE=152,cinder:DELETE=8 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 18 11:50:09 devstack cinder-volume[91663]: DEBUG dbcounter [-] [91663] Writing DB stats cinder:UPDATE=127,cinder:DELETE=13,cinder:SELECT=107,cinder:INSERT=40 {{(pid=91663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}